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ABSTRACT 


This  research  investigated  signal  processing  of  two  dimensional  signals  for  the 
detection  of  targets  in  noise,  particularly  in  complex  background  pattern  noise.  The 
researchers  hypothesized  that  this  type  of  noise  was  vulnerable  to  non-linear 
processing.  They  investigated  whether  the  human  eye/brain  acting  as  a  surrogate  for 
a  non-hnear  processor  could  outperform  an  optimum  hnear  processor  in  a  quantitative 
sense.  The  researchers  did  this  by  conducting  computer  experiments  to  determine  the 
ability  of  an  operator  and  an  optimum  linear  filter  to  determine  a  known  pattern's 
presence  or  absence  in  a  noisy  image.  The  performance  of  both  the  operator  and 
optimum  linear  filter  are  recorded  as  probability  of  detection,  probability  of  false 
alarm  pairs,  which  the  researchers  use  to  determine  effective  signal-to-noise  ratio. 
The  performance  of  man  verus  machine  (optimum  linear  filter)  is  compared 
quantitatively  using  the  effective  signal-to-noise  ratio.  Operator  and  machine/filter 
are  tested  against  circular  targets  in  Random  White  Gaussian  noise  and  in  sattellite 
images.  The  researchers  report  that  the  machine  /filter  outperforms  the  man  when  the 
details  of  both  target  and  background  are  known  in  advance,  but  the  man  outperforms 
the  machine/filter  when  the  details  are  known  only  in  a  statistical  sense. 
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I.  INTRODUCTION 


It  would  be  a  major  advance  in  the  state  of  the  art  to  find  an  algorithm  for 
Automatic  Target  Recognition  (ATR)  which  could  consistently  perform  at  the  same 
level  as  a  trained  human  observer  who  is  given  the  opportunity  to  leisurely  examine 
a  small  field  of  view. 

Prof.  David  L  Fried. 

Automatic  Target  Recognition  (ATR)  for  visible/IR  images  is  a  subject  of  interest  to  the  mil¬ 
itary.  A  lot  of  work  has  been  done.  A  problem  exists  in  that  this  work  progresses  in  an  ad  hoc 
manner  without  a  clear  theory.  Today  we  do  not  have  the  ability  to  produce  ATR  hardware  for  the 
field.  We  believe  this  thesis  will  help  provide  some  of  the  theoretical  basis  for  future  research. 

In  Appendix  A  of  this  thesis  we  review  some  of  the  work  currently  being  conducted  in  the 
ATR  community.  In  reviewing  the  work  already  done  in  ATR  we  noted  that  it  almost  completely 
ignores  the  types  of  filters  which  theory  does  predict  should,  in  a  certain  sense,  be  optimum.  To 
discuss  these  filters  we  reference  some  basic  signal  processing  theory.  In  signal  processing  theory 
when  considering  Gaussian  white  noise  the  matched  filter  is  the  optimum  filter.  When  considering 
Gaussian  non-white  noise  the  optimum  filter  is  the  matched  filter  Fourier  transformed  divided  by 
the  Power  Spectrum  Density  (PSD),  and  then  inverse  Fourier  transformed.  Whether  the  noise  is 
white  or  non-white,  so  long  as  it  is  Gaussian,  the  optimum  filter  is  a  linear  filter.  In  reviewing  the 
ATR  work  we  have  noted  that  it  has  almost  entirely  ignored  optimum  linear  filters. 

We  began  work  with  the  hypothesis  that  the  nature  of  background  clutter  is  such  that  a  ma¬ 
chine  equipped  with  an  optimum  non-linear  filter  would  recognize  targets  in  a  noisy/ cluttered  back¬ 
ground  better  than  a  machine  equipped  with  an  optimum  linear  filter.  We  hypothesized  that  a 
close  approximation  to  the  optimum  non-linear  processor  searching  for  a  known  type  of  target  in 
a  noisy/cluttered  background  is  provided  by  the  human  eye/brain,  when  the  eye/brain  is  allowed 
to  operate  in  a  leisurely  manner.  We  assume  that  after  examining  a  reasonable  number  of  training 
samples  the  eye/brain  combination  should  be  considered  to  be  able  to  achieve  near  optimum  per¬ 
formance.*  If  we  accept  the  human  as  a  near  optimum  non-linear  filter  this  permits  us  to  compare 

*  The  near  optimality  of  the  eye/brain  combination  is  a  hypothesis  which  we  will  not  attempt  to  prove.  It  certainly 
seems  plausible,  and  is  the  underlying  hypothesis  in  current  work  attempting  to  develop  a  neural  net  machine  for 
ATR.  In  any  case  the  ATR- customer  community  would  certainly  be  pleased  to  develop  an  ATR  able  to  perform 
as  well  as  a  human  at  leisure.  The  inability  of  curent  ATR  systems  to  match  a  human’s  performance  is  the 
reason  that  Dr.  Rudolph  G.  Buser  and  Alexander  Akerman  III  have  said  “if  an  ATR  doesn’t  work  near  perfectly 
then  the  human  operators  (referring  to  pilots  and  image  analysts)  will  just  turn  the  system  off.”  Accordingly 
we  feel  quite  comfortable  in  taking  the  performance  capability  of  the  human  eye/brain  combination  working  at 
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performance  of  linear  processors  (which  we  know  how  to  implement  on  a  computer)  with  a  near 
optimum  non-linear  filter  (the  human  eye/brain  combination). 

We  had  expected  the  human,  because  of  his  ability  to  use  non-linear  processing,  to  outperform 
a  machine  using  an  optimum  linear  filter.  We  undertook  to  prove  that  this  was  the  case  since  we 
could  not  find  a  proof  in  the  literature.  We  have  since  come  to  a  somewhat  different  conclusion. 

We  conclude  that  the  optimum  linear  filter  matches  or  outperforms  the  human  surrogate  non¬ 
linear  filter  in  both  the  white  and  non-white  backgrounds  when  the  details  of  the  target  are  known. 
We  also  conclude  that  the  human  outperforms  the  machine/filter  when  the  target  details  are  known 
only  in  a  statistical  sense.  In  carrying  out  this  work  we  came  to  the  following  conclusions: 

Conclusions 

1.  When  the  background  noise  was  Gaussian  and  white  the  linear  filtering  process  outper¬ 
formed  the  human,  but  only  by  about  0.6  dB. 

2.  When  the  background  noise  corresponded  to  satellite  (SPOT)  imagery  of  the  ground,  for  a 
well  camouflaged  target*  a  human’s  performance  was  inferior  (or  for  small  targets,  at  best, 
equivalent)  to  that  of  a  machine  that  used  an  optimum  linear  filter. 

3.  We  observed  that  a  human  was  able  to  detect  background  pattern  anomalies  of  a  type  which 
we  would  associate  with  imperfect  camouflage.  The  machine  equipped  with  the  optimum 
linear  filter  was  unable  to  take  note  of  these  anomolies.^ 

Conclusion  1  presented  no  major  surprise.  The  signal  processing  concept  is  presumably  the 
same  for  both  man  and  machine.  The  performance  of  the  man  falls  short,  but  only  by  about  0.6  dB. 
We  were  pleasantly  surprised  by  the  results  referred  to  in  Conclusion  2.  Although  it  contradicted 
our  original  hypothesis,  it  is  seen  as  a  positive  result.  It  tells  us  what  filter  to  use  for  optimum  (time 
unconstrained)  performance  when  the  target  is  of  a  known  form.  This  thesis  suggests  that  researchers 
should  place  more  emphasis  than  is  apparently  being  given  to  the  investigation  of  optimum  linear 


a  leisurely  pace  as  our  reference  point. 

*  We  consider  a  well  camouflaged  target  to  be  one  which  does  not  “break”  the  natural  pattern  of  the  background 
clutter  but  only  adds  its  additional  signature  component  to  the  image  scene. 

t  We  understand  that  exploitation  of  conclusion  2  introduces  the  “curse  of  dimensionality,”  that  there  are  very 
many  target  image  patterns  to  be  looked  for.  However,  with  the  regular  and  exponential  growth  of  the  amount 
of  computing  power  that  has  been  seen  for  the  past  decade  and  we  feel  can  be  projected  for  the  next  decade, 
it  seems  to  us  that  emphasis  in  the  ATR  development  problem  has  to  be  put  on  developing  an  algorithm  that 
works  well  enough.  Only  then  should  the  major  part  of  the  effort  be  put  into  getting  the  algorithm  to  rim  fast 
enough. 

f  Conclusion  3  noted  above  supports  our  original  hypothesis.  We  feel  that  exploitation  of  a  non-linear  process 
that  can  imitate  a  human  provides  a  potentially  highly  effective  approach  to  the  ATR  problem. 
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filters.  Conclusion  3  indicates  that  non-linear  processing  may  provide  better  ATR  performance  than 
linear  processing  under  the  right  circumstances.  We  recommend  that  researchers  further  examine 
the  human  non-linear  process  in  follow-on  work. 

We  designed  experiments  to  test  our  hypothesis  using  the  following  methodology: 

1.  We  presume  that  the  eye/brain  combination  can  be  as  non-linear  as  optimality  requires  and 
so  can  use  a  human  as  our  surrogate  for  the  optimum  non-linear  filter.  The  level  of  ongoing 
work  with  (ATR)  neural  nets  and  a  general  consensus  in  the  research  literature  leads  to 
the  conclusion  that  the  human  eye/brain  combination’s  performance  can  be  considered  to 
be  acceptably  close  to  optimum  (if  allowed  adequate  time). 

2.  We  know  how  to  write  algorithms  for  an  optimum  linear  filter  and  so  can  put  it  on  a 
machine  such  as  a  computer. 

These  two  items  of  methodology  allow  us  to  conduct  a  comparison  of  the  linear  and  non-linear 
optimum  filters.  Our  methodology  consists  of  testing  humans  (to  whom  we  give  lots  of  time  to  make 
a  decision)  and  machines  against  the  same  class  of  target/background  images.  We  then  compare 
their  performance  to  decide  the  merit  of  a  non-linear  filter. 

The  basic  experiment  consists  of  two  parts.  The  first  part  involves  showing  a  human  tar¬ 
get/background  patterns  displayed  on  a  computer  monitor  and  recording  his  decisions  (i.e.,  the 
human  decides  if  the  target  is  present  or  if  the  target  is  not  present).  We  (or  more  accurately  stated 
the  computer  operating  as  the  control  center  of  the  experiment)  uses  the  operator’s  inputs  to  de¬ 
termine  his  Probability  of  Detection  (Pd)  and  his  Probability  of  False  Alarm  (Pfa)-  The  Pd  and 
Pf.a  considered  together  form  what  we  call  a  (PD,PFA)-pair.  We  (i.e.,  the  computer)  then  conduct  a 
similar  experiment  with  the  machine/ filter  using  image  data  sets  with  the  same  kinds  of  background 
and  target  definition/parameters  that  were  used  to  generate  the  images  shown  to  the  human.  These 
data  sets  are  presented  to  a  separate  program  in  the  computer  which,  based  on  an  optimum  linear 
filter  and  some  threshold  setting,  implements  what  we  call  the  machine/filter.  The  machine/filter 
decides  if  the  target  is  present  or  not  present.  From  the  machine/filter’s  decisions  we  determine 
the  machine/filter  (PD,PFA)-pair  —  doing  this  for  various  threshold  settings.  For  each  threshold 
setting  we  compute  a  separate  (Pd, Pfa) -pair.  When  plotted  this  set  of  pairs  forms  a  curve  called 
the  Receiver  Operating  Characteristic  (ROC). 

It  is  useful  to  present  (PD,PFA)-pairs  and  the  ROC  on  a  specialized  graph  which  we  have  called 
a  probability-probability  (PRBPRB)  graph.  Since  the  PRBPRB  graph  is  not  commonly  used  we 
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will  discuss  it  in  enough  detail  for  the  reader  to  understand  the  data  presented  in  this  thesis. 

The  PRBPRB  graph  shows  probability  of  detection  on  the  vertical  axis  and  probability  of  false 
alarm  on  the  horizontal  axis.  These  axes  are  not  linearly  spaced.  They  are  spaced  in  such  a  way 
that  any  change  in  probability  corresponding  to  one  standard  deviation  (of  a  Gaussian  probability 
distribution)  always  represents  the  same  axis  length.  An  example  of  a  PRBPRB  graph  without  any 
data  plotted  is  shown  in  Fig.l.  We  use  these  PRBPRB  plots  through  out  the  thesis  to  present, 
analyze  and  compare  experimental  results. 

We  next  discuss  the  probability  concept  and  some  commonly  used  graphical  representations 
which  the  reader  will  probably  recognize.  Fig  .2  is  a  plot  on  a  linear  scale  of  the  probability  densities 
inferred  from  a  set  of  samples  drawn  from  a  normal  distribution.  R  is  the  familiar  bell  shaped  curve 
centered  at  zero.  The  reason  we  don’t  use  it  to  plot  data  is  that  it  is  difficult  to  form  a  comparison 
of  experimental  results  from  it.  For  example,  we  can  not  use  it  to  approximate  Pd  or  Pfa-  We  want 
a  better  way  to  graphically  present  experimental  data,  which  is  in  the  form  of  (PD,PFA)-pairs. 

Fig. 3  shows  a  plot  of  cumulative  probability  densities  plotted  on  a  linear  scale.  The  cumulative 
probability  densities  are  generated  from  the  same  set  of  Gaussian  normal  distribution  sample  values 
used  for  Fig. 2.  The  cumulative  probability  distribution  plot  has  linear  vertical  and  horizontal  axes. 
It  is  also  difficult  to  use  these  graphs  to  display  (PD,FVA)-pairs  nor  is  it  clear  how  one  might  use  such 
a  graph  to  form  an  estimate  of  the  Effective  Signal-To-Noise  Ratio  (SA'Peff)  that  can  be  associated 
with  the  (PD,PFA)-pair. 
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FIGURE  1.  PRBPRB  Graph.  The  above  figure  is  a  PRBPRB  graph 
without  any  data  plotted.  The  reader  may  not  be  familiar  with 
the  axis  convention.  The  axes  are  spaced  evenly  by  standard 
deviations  of  a  Gaussian  about  a  mean  value  of  0.5  at  the 
midpoint  corresponding  to  zero  standard  deviations . 
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FIGURE  2.  Bell  Shaped  Curve.  The  above  figure  shows  a  linear 
plot  of  the  probability  densities  of  a  random  normal 
distribution.  It  is  the  familiar  Gaussian  curve.  The  results 
shown  are  based  on  a  set  of  90,000  randomly  chosen  values. 
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FIGURE  3.  Cumulative  Probability  Distribution.  This  figure 
shows  a  plot  of  a  cumulative  probability  distribution  plotted  on 
a  linear  scale.  The  plot  has  a  distinctive  S  shape.  Note  that 
probabilities  of  interest  for  ATR  (values  near  zero  and  one)  are 
squeezed  together  somewhere  on  the  nearly  horizontal  portions  of 
the  curve . 


For  example,  try  to  compare  a  probability  (vertical  axis)  of  0.99  with  a  probability  of  0.999. 
Examine  the  plot  and  you  will  note  that  these  probabilities  appear  squeezed  together  on  the  nearly 
flat  horizontal  portion  of  the  graph.  The  difference  in  performance  of  an  ATR  which  achieves  a 
(Pd)  of  0.999  and  one  which  achieves  a  Poof  0.99  [given  that  they  both  achieve  the  same  (Pfa)] 
is  very  significant.  This  inability  to  adequately  represent  the  significant  difference  in  probabilites 
that  are  of  interest  to  those  researching  the  ATR  problem  on  a  linear  graph  drove  us  to  use  a  more 
representative  graph. 

Fig. 4  shows  the  same  cumulative  probability  densities  of  Fig. 3  plotted  on  a  graph  which  uses 
a  linear  scale  for  the  horizontal  axis  and  a  probability  scale  for  the  vertical  axis  (called  a  LINPRB 
plot).  It  is  easy  to  see  on  this  graph  the  difference  between  probability  spacing  (vertical)  axis  and 
linear  spacing  (horizontal)  axis.  For  instance, examine  the  point  0.5  on  the  horizontal  axis  and  the 
vertical  axis.  On  the  vertical  axis  (which  is  probability  spaced)  the  distances  between  tick  marks  are 
evenly  spaced  by  their  percent  standard  deviation  from  the  Gaussian  distribution’s  mean  value  (in 
this  case  0.5).  The  effect  of  plotting  the  cumulative  probability  densities  of  a  normal  distribution 
on  this  graph  is  that  they  form  a  nearly  straight  line  as  can  be  seen  in  Fig. 4.  The  plot  also  creates 
more  “working  space”  for  the  interesting  probability  values  near  zero  and  one  (i.e.,  probabilities 
that  correspond  to  desirable  PpA^nd  Pq  respectively).  Look  at  the  graph.  There  is  a  lot  of  space 
between  a  probability  with  a  value  of  0.99  and  another  probability  with  a  value  of  0.999.  The 
same  effect  is  true  for  probabilities  near  zero,  which  we  would  be  interested  in  if  we  wished  to 
recognize,  for  example,  the  difference  between  Pfa=10  x  and  Pfa=1.0  x  10~5.  The  use  of 
such  a  probability  scale  provides  the  most  useful  convention  for  plotting  probability  data  resulting 
from  our  experiments. 

The  next  set  of  figures  illustrates  how  we  compare  probability  data  using  PRBPRB  graphs.  For 
a  PRBPRB  graph  both  the  horizontal  and  the  vertical  axes  have  probability  scales.  We  mentioned 
earlier  that  each  experiment  yielded  one  operator  (PD,PFA)-pair  and  a  set  of  machine  (PD,PFA)-pairs, 
constituting  the  ROC,  as  data.  We  next  discuss  the  presentation  of  this  data. 

In  Fig. 5  a  typical  operator  (PD,FVA)-pair  is  plotted.  The  reader  should  be  able  to  read  the 
operator  (PD,PFA)-pair  from  the  graph.  Prom  Fig. 5  we  approximate  Pd  as  0.92  and  the  PpA  as  0.08. 
The  reader  will  note  that  use  of  the  probability  scales  provides  better  resolution  of  (PD,PFA)-pairs 
than  a  linear  scale.  The  scale  is  essentially  (usefully)  expanded  at  the  places  of  interest.  The  use  of 
the  probability  scales  provides  a  convenient  way  of  associating  an  SAPgffwith  a  (PD,PFA)-pair. 
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FIGURE  4.  Cumulative  Probability  Plot.  The  same  data  is  plotted 
here  as  is  plotted  in  Fig. 3.  The  above  figure  shows  the 
cumulative  probability  distribution  plotted  on  a  probability 
scale.  This  has  the  effect  of  straightening  the  S  shaped  curve 
appearing  on  the  previous  linear  plot.  Note  the  curve  is  a 
straight  line  with  working  space  at  the  points  of  interest,  near 
zero  and  one. 
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FIGURE  5.  PRBPRB  Plot  Of  Operator  (Probability  Of  Detection., 
Probability  Of  False  Alarm) -Pair .  The  reader  should  convince 
himself  that  the  operator  probability  of  detection  read  off  the 
graph  is  0.92  and  the  operator  probability  of  false  alarm  is 
0.08.  This  plot  also  shows  the  uncertainty  in  the  operator  point 
with  error  lines.  The  operator (probability  of  detection, 
probability  of  false  alarm) -pair  is  marked  with  an  o.  The  error 
bars,  corresponding  to  plus  and  minus  one  standard  deviation,  are 
the  horizontal  and  vertical  lines  through  the  o. 


In  Fig. 6  we  plot  machine  performance  on  the  PRBPRB  graph.  In  the  experiments  machine 
data  was  collected  as  a  set  of  (PDiPFA)-pairs,  each  pair  corresponding  to  a  different  threshold  (i.e., 
corresponding  to  a  different  balance  between  missed  detections  and  avoiding  false  alarms).  We 
plotted  these  (PDjF’FA)-pairs  yielding  the  machine  ROC.  The  ROC  is  shown  as  a  short  curved  line 
in  Fig. 6. 

In  Fig. 7  we  show  the  results  of  a  hypothetical  experiment.  Data  is  shown  for  a  machine/filter 
and  for  an  operator.  The  results  for  machine/ filter  and  for  the  operator  are  plotted  using  a  PRBPRB 
graph.  Without  discussing  the  results  of  the  experiments  at  this  time  we  point  out  that  better 
performance  results  in  data  plotted  up  and/or  to  the  left  corresponding  to  higher  Pd  and  lower 
Pfa-  Weaker  performance  gets  plotted  lower  and/or  to  the  right  —  corresponding  to  lower  Pd  and 
higher  Pfa-  For  Fig. 7  we  would  conclude  that  the  machine/filter  outperforms  the  operator. 

You  might  be  interested  to  see  the  same  data  plotted  on  a  linear  graph.  Fig  .8  shows  this. 
Notice  that  the  points  of  interest  are  squeezed  together  at  zero  and  one,  making  it  difficult  to  read 
(Fd, -Pfa) -pairs. 

When  we  consider  the  comparison  of  machine  performance  with  operator  performance  we  rec¬ 
ognize  that  the  machine  performs  better  than  the  operator.  We  then  ask  the  question  “how  much 
better?”  We  can  quantitatively  answer  this  question  by  adopting  the  technique  of  associating  an 
{SN Res)  with  a  (Pq,  PFA)-pair.  This  SNRqs  provides  the  basis  for  comparing  machine  and  oper¬ 
ator  performance  and  assessing  how  much  better  the  performance  of  one  is  relative  to  that  of  the 


FIGURE  6.  PRBPRB  Graph  Of  Machine/Filter  (Probability  Of 
Detection,  Probability  Of  False  Alarm) -Pairs .  The  above  graph 
shows  machine/filter  (probability  of  detection,  probability  of 
false  alarm)  pairs  displayed  on  a  PRBPRB  plot. 
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FIGURE  7.  PRBPRB  Graph  Of  Machine/Filter  (Probability  Of 
Detection,  Probability  Of  False  Alarm) -Pairs .  The  above  graph 
shows  machine/filter  (probability  of  detection,  probability  of 
false  alarm)  pairs  displayed  on  a  PRBPRB  plot. 
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FIGURE  8.  Operator,  Machine/Filter  Linear  Plot.  Note  that  the 
points  of  interest  are  clumped  about  zero  and  one  and  are 
difficult  to  read.  The  same  data  is  shown  as  is  plotted  in  Fig. 

7  . 
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The  significance  of  the  variable  SNReft  can  best  be  understood  by  considering  a  signal  along 
with  Gaussian  noise  with  various  Signal-To-Noise  Ratios  (SNR’s).  For  a  given  SNR  we  get  a  set  of 
(Pd,Ffa) -pairs  (each  pair  corresponding  to  some  particular  threshold  setting)  and  from  such  a  set  of 
(P[5,Pp^) -pairs  we  form  a  curve.  Such  a  curve  of  {Pd,Pfa)  will  be  a  straight  line  when  plotted  on  a 
PRBPRB  graph  as  a  consequence  of  the  noise  having  a  Gaussian  distribution.  Fig.  9  shows  ten  such 
[PcijPfa)  curves,  each  curve  corresponding  to  a  different  target  signal  strength  and  thus  a  different 
SNR.  The  line  farthest  down  and  to  the  right  represents  the  smallest  SNRefc  {SN ReS=l)-  The  line 
farthest  up  and  to  the  left  represents  the  highest  SNReff  {S N Reff=lO).  When  we  examine  these 
Gaussian  Signal- To-Noise  Ratio  lines  (which  we  shall  call  “GLINES” )  we  see  that  we  can  associate 
a  (Pd)Ffa)  pair  with  a  particular  SNRe({-  We  associate  a  higher  S’NPeffwith  a  better  receiver 
operating  characteristic  and  better  performance. 

We  shall  use  these  curves  to  estimate  5NReff  remembering  that  we  must  have  a  (PD,PFA)-pair 
to  estimate  SN ReS-  In  fact,  given  any  two  of  the  three  quantities  SNReff,  Pd,  and  PpA  we  can  use 
the  PRBPRB  graph  to  estimate  the  third.  We  can  read  the  remaining  quantity  from  the  graph. 

We  use  these  PRBPRB  graphs  with  the  GLINES  to  plot  (Pd>Ffa)  data  and  infer  SNReS 
values  from  our  experiments.  We  then  compare  the  SNReff  of  the  operator  with  the  SNReff 
of  the  machine.  For  instance,  in  Fig.  10  we  have  plotted  the  set  of  machine  (PD,'PFA)-pairs  (the 
curved  line)  and  the  operator  (PD,PFA)-pair  (the  circle)  on  a  PRBPRB  graph  with  GLINES.  We  can 
approximate  from  the  GLINES  that  the  operator  SN Reff  is  about  2.8  and  that  the  machine  SN Reff 
is  about  7.0  (reading  the  max  value).  Since  these  are  signal-to-noise  voltage  ratios  the  difference 
corresponds  to  201ogio  (7/2.8)  or  about  8.0dB.  This  example  shows  how  the  PRBPRB  graph  with 
the  GLINES  can  be  used  to  approximate  the  SNReff  for  both  the  operator  and  the  machine.  We 
use  the  SNReff  as  a  measure  of  performance  and  the  dB  difference  between  two  SNReff  values 
to  compare  performance  —  higher  SNReff  being  associated  with  better  performance.  We  think 
this  is  an  unambiguous  and  useful  technique  and  recommend  that  the  ATR  community  consider 
adopting  it  or  some  similarly  unambiguous  technique  as  a  convention  for  discussing  and  comparing 
ATR  machine/filter  performance. 
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FIGURE  9 .  PRBPRB  Graph  With  Gaussian  Equivalent  SNR  Lines .  The 
above  figure  depicts  ten  lines  corresponding  to  signal-to-noise 
ratios  from  one  (labelled  in  lower  left  corner)  to  ten  (labelled 
in  upper  left) .  The  horizontal  and  vertical  axes  use  probability 
scales . 
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FIGURE  10.  PRBPRB  Plot  With  Gaussian  Equivalent  SNR  Lines  Of 
Operator  And  Machine  Performance.  The  above  graph  shows  an 
operator  (probability  of  detection,  probability  of  false  alarm) - 
pair  and  a  set  of  machine  (probability  of  detection,  probability 
of  false  alarm) -pairs  on  a  PRBPRB  graph  with  GLINES .  The  GLINES 
are  labelled  from  the  lowest ( SNR=1 )  to  the  highest ( SNR=10 ) .  In 
the  above  example  the  machine  has  an  effective  signal-to-noise 
ratio  of  about  7.0  and  the  operator  has  an  effective  signal-to- 
noise  ratio  of  about  2.8.  Thus  the  operator  performance  is  about 
8dB  down  from  that  of  the  machine/ filter .  The  PRBPRB  graph  with 
GLINES  is  useful  for  approximating  effective  signal-to-noise 
ratio,  which  we  use  as  a  measure  of  performance. 


The  SNReffcan  also  be  calculated  analytically.  The  formulaes  used  to  analytically  calculate 
SNReff  are  discussed  next.  This  analytic  calculation  of  SN  Red  is  more  accurate  than  the  graphi¬ 
cal  approximation.  SNReS  is  calculated  analytically  from  a  (Pd.  T’F.\)-pair  according  to  the  equa¬ 
tion 


SNReff  =  V2  [erf- 1(1  -  2Pfa)  -  erf-i(l  -  2Pd)]  ,  (1) 

where  the  function  erf  ^(x)  is  the  inverse  of  the  standard  error  function,  erf(x),  which  is  defined  by 
the  equation 


erf(x)  = 


dt  exp(— . 


(2) 


The  basis  for  writing  Eq.  (1)  for  the  (Gaussian  equivalent)  or  SNReft,  lies  in  the  consideration  that 
if  we  were  dealing  with  a  signal  of  magnitude  s  in  Gaussian  noise  with  standard  deviation  a  for 
which  we  can  consider  that 


SN  Reff  =  s/a  , 


(3) 


then  if  the  detection  threshold  were  set  at  level  T  we  would  have 


fT/(aV2) 

PpA  =  1  —  2/7r  /  dt  exp  (  —  , 


(4) 


and 


PD=h 


(T-s)/ioV2) 


dt  exp  (  —  • 


(5) 


We  can  derive  Eq.  (1)  from  Eq.’s  (3),  (4),  and  (5). 

Previously  when  discussing  the  PRBPRB  graphs  we  approximated  the  SNResas  3.0  for  a 
(Pd,  PFA)-pair  of  (0.92,0.08).  We  can  use  this  pair  and  Eq.  (1)  to  analytically  calculate  SNReR= 
2.8101.  We  can  then  see  that  our  approximation  is  close  to  the  analytic  value  and  suitable  for  the 
performance  comparisons  we  will  make  between  machine  and  operator. 


18 


II.  EXPERIMENTAL  APPROACH 

We  conducted  a  number  of  experiments  using  three  types  of  targets  and  two  types  of  back¬ 
grounds  comparing  operator  performance  with  that  provided  by  various  types  of  filters.  The  three 
target  types  are  referred  to  as  “Transparent,”  “Uniform-Opaque,”  and  “Camouflaged-Opaque.”  The 
two  background  types  were  “Random  White  Gaussian  (RWG)”  and  “SPOT”  patterns. 

All  the  targets  were  disk  shaped  and  nominally  uniform  across  the  disk.  (We  shaped  the  targets 
as  closely  as  possible  to  disks  given  the  square  pixel  array  their  patterns  were  fit  onto.)  Targets  had 
some  particular  level  of  signal  strength  above  the  local  average  background.  This  excess  of  the  signal 
strength  above  the  local  average  background  we  shall  refer  to  as  the  target’s  signature. 

For  the  Transparent  target  the  background  pattern  was  altered  only  by  adding  the  target 
signature  to  the  background  value  of  each  pixel  “covered”  by  the  target  disk. 

For  the  Uniform- Opaque  target  each  pixel  covered  by  the  disc  was  given  the  same  value,  a  value 
equal  to  the  target  signature  plus  the  average  of  all  the  background  pixel  values  covered  by  the  disk. 

For  the  Camouflaged-Opaque  target  we  used  the  same  Uniform-Opaque  target,  but  then  also 
added  a  camouflage  pattern  on  top  of  the  uniform  pattern.  We  obtained  the  camouflage  pattern 
by  randomly  selecting  a  disk  shaped  region  from  somewhere  else  on  the  SPOT  background  image. 
From  this  region  we  extracted  a  pattern  which  was  the  same  size  as  the  target  disk  and  introduced 
a  bias  to  make  the  (camouflage)  pattern  thus  extracted  have  a  zero  mean  value.  Examples  of  the 
three  target  types  are  shown  in  Fig.’s  14,  15,  and  16.  The  association  of  these  targets  with  real  world 
target  situations  is  discussed  shortly. 

We  conducted  experiments  with  (background  clutter)  noise  either  generated  by  the  computer  (in 
the  case  of  white  Gaussian  noise)  or  obtained  from  satellite  imagery  of  Jacksonville,  Fla.  (obtained 
from  the  French  SPOT  satellite  system).  We  found  that  for  the  satellite  imagery  and  Transparent 
target  the  optimum  linear  filter  operates  with  an  51V Reft  ranging  from  significantly  higher  than  to 
just  a  bit  better  than  the  operator’s  —  how  much  better  depending  on  the  target  size.  For  the 
“Camouflaged  Opaque”  target  in  SPOT  background  the  operator  achieves  a  significantly  higher 
51V Reft  than  the  machine/filter  for  all  target  sizes. 

We  generated  the  two  types  of  backgrounds  in  the  following  manner.  Random  White  Gaussian 
(RWG)  backgrounds  were  generated  by  setting  each  pixel  to  the  same  value,  a  value  between  zero  and 
one.  We  then  added  to  the  pixels  a  Gaussian  random  value  with  a  standard  deviation  considerably 
less  than  unity.  The  choice  of  the  random  values  added  was  statistically  independent  from  pixel  to 
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pixel.  The  results  were  then  clipped  to  lie  between  zero  and  one.  An  example  of  RWG  background 
is  shown  in  Fig.  11.  The  background  pattern  thus  produced  had  no  identifiable  features. 

SPOT  images  were  generated  by  randomly  selecting  a  small  section  of  pixels  from  a  large  SPOT 
image  of  Jacksonville,  Fla.  area.  Although  the  background  clutter  was  random,  features  both  man 
made  and  natural  were  clearly  visible.  These  features  had  distinct  edges.  An  example  of  the  satellite 
imagery  is  shown  in  Fig.  12. 

We  used  two  different  types  of  filters  in  the  experiments.  These  were  the  matched  filter  and  the 
optimum  filter.  In  order  to  understand  these  filters  the  reader  must  be  familiar  with  some  signal 
processing  terms.  We  next  discuss  the  meaning  of  these  terms.  A  discussion  of  SNR,  Power  Spectral 
Density  (PSD),  optimum  filter,  optimum  linear  filter,  and  matched  filter  follow. 

The  SNR  is  the  ratio  of  the  average  of  all  measurements  taken  in  a  set  of  observations  when 
there  is  a  target  present,  minus  the  average  of  all  the  measurements  taken  when  there  is  no  target 
present  (i.e.,  the  target  signature),  divided  by  the  rms  deviation  of  all  the  measurements  taken  when 
the  target  was  always  present  (or  the  rms  deviation  when  the  target  was  always  absent). 

The  use  of  the  term  SNR  implies  the  use  of  some  filter  and  of  a  sample  selection  process.  Note 
that  in  defining  the  SNR  we  refer  to  measurements  when  describing  both  the  signal  (numerator) 
and  the  noise  (denominator).  In  making  a  measurement  some  environmental  effect  (light,  heat, 
temperature)  interacts  with  a  sensor  to  produce  an  array  of  data  that  is  then  input  to  a  filter. 
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FIGURE  11.  Random  White  Gaussian  Background.  The  above  figure 
shows  an  example  of  Random  White  Gaussian  background.  There  is  no 
target  present  in  this  figure.  Note  there  are  no  identifiable 
patterns  (features)  in  the  background. 
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FIGURE  12.  SPOT  Background.  The  above  figure  shows  a  spot  image. 
In  this  case  there  is  no  target  present.  Note  there  are  clearly 
distinguished  patterns  (features)  in  the  background.  Linear 
filters  can  not  take  advantage  of  the  nature  of  these  features 
when  deciding  if  a  target  is  present  or  not  present. 
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The  filter  may  be  thought  of  as  some  algorithm  which  processes  a  sequence  of  sensor  output 
values  to  produce  a  sequence  of  filter  output  values.  One  output  value  for  each  possible  source/target 
position  with  output  sampling  to  correspond  with  some  particular  possible  source/target  position 
of  the  filter.  Though  filters  are  often  thought  of  in  terms  of  the  processing  of  the  various  frequency 
components  of  the  signal  input  to  the  filter  it  is  at  least  as  relevant  to  think  of  a  filter  as  acting 
directly  on  each  of  the  input  sample  values  and  it  is  in  that  sense  that  we  shall  generally  consider 
a  filter.  If  the  filter  is  a  linear  filter  then  it  is  equivalent  to  the  process  of  forming  a  sum  of  a 
set  of  weighting  factors,  each  times  one  of  the  input  signal  sample  values.  (The  sequence  of  filter 
output  values  corresponds  to  the  forming  of  this  sum  with  a  sequence  of  different  shifts  between  the 
weighting  factors  and  the  input  signal  sample  values.  Taking  a  single  sample  of  the  filter’s  output 
corresponds  to  restricting  attention  to  a  single  relationship  between  the  weighting  factors  and  the 
input  signal  sample  values.)  A  linear  filter  may  be  considered  to  be  defined  by  it’s  set  of  weighting 
factors. 

The  PSD  is  the  Fourier  transform  of  the  covariance  of  the  background  pixel  values  (nominally 
produced  by  a  sensor).  The  PSD  may  be  considered  to  define  the  frequency  content  of  a  random 
signal,  in  this  case  of  the  background,  that  will  be  part  of  the  signal  going  into  our  filter. 

The  term  matched  filter  refers  to  a  linear  filter  which  when  expressed  as  a  pattern  of  weighting 
factors  may  be  considered  to  have  the  same  “shape”  as  the  target’s  nominal  signal  amplitude.  In 
the  two  dimensional  work  of  our  thesis  the  matched  filter  for  our  circular  target  is  a  disk  shaped 
pattern  of  equal  weights,  surrounded  by  a  set  of  weights  each  equal  to  zero. 

An  optimum  filter  refers  to  a  filter  which  when  applied  to  a  signal  yields  the  maximum  possible 
SNR.  It  may  be  linear  or  non-linear.  In  the  case  of  RWG  noise  the  optimum  filter  is  known  to  be 
the  matched  filter. 

An  optimum  linear  filter  is  optimum  only  relative  to  the  maximum  SNR  produced  by  all  other 
linear  filters.  It  is  possible  that  some  non-linear  filter  can  produce  a  higher  SNR  than  that  produced 
by  the  optimum  linear  filter.  For  Gaussian  noise  that  is  not  white  the  optimum  linear  filter  is  a 
linear  filter  whose  weighting  factors  correspond  to  the  matched  filter  Fourier  transformed,  divided 
by  the  PSD,  and  then  inverse  Fourier  transformed. 

We  hypothesized  that  the  human  eye/brain  combination  would  perform  as  an  optimum  non¬ 
linear  filter. 

In  describing  the  experiments  we  conducted  we  will  refer  to  various  target  types.  This  next 
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section  discusses  each  of  these  targets  in  one  of  the  previously  mentioned  backgrounds  and  describes 
the  extent  to  which  these  target/background  combinations  may  be  considered  to  be  related  to  real 
world  target  situations. 

As  already  mentioned,  the  experiments  used  two  types  of  background  (RWG,  SPOT)  and  three 
target  types.  The  three  target  types  are  referred  to  as  “Transparent,”  “Uniform-Opaque,”  and 
“Camouflaged-Opaque.” 

We  combined  these  backgrounds  and  targets  in  three  combinations  each  corresponding  to  one 
of  the  experiments.  These  combinations  were: 

1.  Experiment  1.  Transparent  targets  in  Random  White  Gaussian  (RWG)  backgrounds. 

2.  Experiment  2.  Transparent  targets  in  SPOT  images. 

3.  Experiment  3.  Gamouflaged-Opaque  targets  in  SPOT  images. 

We  considered  conducting  experiments  with  a  fourth  combination  which  was  “Uniform-Opaque” 
targets  in  SPOT  images  but  these  targets  were  too  easy  for  the  operator  to  detect  and  we  didn’t 
believe  the  experiment  would  yield  any  insight  to  the  non-linear  filtering  process  we  were  investigat¬ 
ing. 

When  we  refer  to  Transparent  targets  we  mean  targets  that  added  the  target  signature  level  to 
the  background  signal  level  for  each  pixel  covered  by  the  target  disk.  The  Transparent  targets  were 
the  most  difficult  targets  for  the  operator  to  detect.  In  effect,  the  Transparent  targets  had  perfect 
camouflage.  They  did  not  disrupt  the  background  pattern;  they  only  added  a  constant,  the  targets 
signature  level,  to  the  background  pattern.  An  example  of  the  Transparent  target  in  both  RWG, 
and  a  SPOT  image  (the  first  and  second  combination)  is  shown  in  Fig.’s  13  and  14. 
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FIGURE  13 .  Random  White  Gaussian  Background  With  A  Transparent 
Target.  The  above  figure  shows  random  white  Gaussian  background 
with  a  target  present.  Look  closely  at  the  center  of  the  image, 
the  target  has  a  diameter  of  21  pixels. 
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FIGURE  14.  SPOT  Image  With  A  Transparent  Target.  The  above  figure 
shows  a  SPOT  image  with  a  target  present.  Look  closely  at  the 
center  of  the  image.  The  target  which  has  diameterter  of  21 
pixels  is  just  barely  perceptable. 
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When  we  refer  to  either  of  the  opaque  class  of  targets  we  mean  targets  which,  when  displayed, 
had  a  uniform  signal  level.  For  each  pixel  covered  by  the  target  the  target’s  signal  (the  same  value 
for  all  target  pixels)  was  substituted  for  the  background.  This  created  the  effect  of  a  uniform 
uncamouflaged  target  region  that  was  very  clearly  not  part  of  the  background  though  the  target 
pixel  value  was  set  to  be  only  just  a  bit  above  (or  in  some  cases  not  at  all  above)  the  average  of  the 
background  pixel  values  covered  by  the  target.  The  operator  could  recognize  background  patterns 
and  features  and  easily  decide  that  the  “Uniform-Opaque”  target  feature  was  distinctly  different 
from  these  background  features.  Since  the  “Uniform-Opaque”  target  was  very  easy  for  the  operator 
to  detect  we  did  not  do  any  quantitative  work  with  it.  An  example  of  the  Uniform  Opaque  target 
in  a  SPOT  image  is  shown  in  Fig.  15. 

When  we  speak  of  camouflaged  targets  we  refer  to  targets  that  are  closely  matched  to  but  are 
imperfectly  camouflaged  relative  to  the  Transparent  targets.  We  created  the  imperfect  camouflage 
by  generating  targets  with  a  uniform  signal  level  as  we  did  with  the  Uniform  Opaque  target.  We  then 
randomly  selected  a  target-size  camouflage  pattern  from  somewhere  other  than  the  the  immediate 
vicinity  of  the  target  position  and  added  that  camouflage  pattern  to  the  uniform  target  pattern.  We 
biased  the  camouflage  pattern  so  that  it  had  a  zero  mean  signal  value  —  so  it  did  not  change  the 
target’s  average  signature.  The  net  effect  was  a  uniform  signal  target  with  a  nonuniform,  zero-mean 
camouflage  pattern  that  was  statistically  a  good  match  to  the  background,  but  did  not  “join  up”  to 
the  background  very  well  at  the  target  edges.  An  example  of  the  Camouflaged-Opaque  target  in  a 
SPOT  image  is  shown  in  Fig.  16. 

We  formulated  each  of  these  three  types  of  target  patterns  to  correspond  (in  a  loose  sense)  to 
certain  aspects  of  real  world  target  situations.  A  description  of  one  example  of  a  real  world  target 
situation  with  characteristics  corresponding  to  each  target  follows. 

The  Transparent  target  could  represent  a  military  vehicle  (i.e.,  a  tank)  giving  off  an  infrared 
(IR)  signal.  The  tank  will  absorb  the  IR  energy  until  its  temperature  equals  the  mean  value  of  the 
background  temperature.  That  is  the  tank  absorbs  and  emits  energy  until  it’s  temperature  reaches 
equilibrium  with  the  surrounding  environment.  When  the  tank  has  some  internal  heat  source  (i.e., 
an  engine  or  a  space  heater)  this  heat  source  produces  additional  IR  energy  which  causes  the  tank’s 
IR  signature  to  be  above  the  IR  signal  produced  by  the  mean  background  temperature. 
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FIGURE  15.  SPOT  Image  With  Opaque  Target.  Shown  above  is  a  SPOT 
image  with  an  opaque  target.  These  targets  were  very  easy  to 
recognize  because  the  target  completely  covered  the  background 
irregularities.  We  did  not  do  any  work  with  these  types  of 
targets . 
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FIGURE  16.  SPOT  Image  With  A  Camouflaged  Opaque  Target.  The 
above  figure  shows  a  SPOT  image  with  a  Camouflaged  Opaque  Target. 
Look  closely  at  the  center  of  the  background  and  find  the  target 
(it  is  difficult  to  see)  then  work  your  way  out  to  the  target 
edges.  You  will  note  that  the  edges  don't  quite  'match  up'  with 
the  background. 
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Finally  if  the  tank  has  a  reasonably  smart  crew  then  they  will  not  park  the  tank  in  the  open,  but 
seek  out  some  natural  camouflage.  The  natural  camouflage  if  it’s  like  light  shrubbery  is  not  solid,  it 
also  produces  IR  energy  which  is  added  to  the  overall  target  signal.  The  natural  camouflage  is  not 
uniform;  therefore,  the  target  will  not  appear  to  have  a  uniform  IR  signal.  Moreover,  the  nonunifor¬ 
mities  have  a  pattern  similar  to  the  background.  Each  of  the  IR  sources  (tank,  mean  background, 
and  natural  camouflage)  are  essentially  cumulative.  The  Transparent  target  in  our  experiment  treats 
the  various  background  signals  and  target  signal  cumulatively.  Thus,  the  Transparent  targets  in  a 
sense  simulate  many  real  world  target  detection  situations  where  the  targets  have  “near  perfect” 
camouflage,  (i.e.,  camouflage  that  blends  into  the  background  with  no  discontinuities). 

Opaque  targets  simulate  a  target  that  has  a  uniform  signal  level.  An  uncamouflaged  vehicle 
with  a  uniform  IR  emission  is  an  example.  For  instance  a  tank  in  an  open  field  with  its  hot  engine 
off  long  enough  for  a  uniform  temperature  distribution  to  have  developed  somewhat  above  that  of 
the  background.  When  we  displayed  the  opaque  targets  to  the  operator  we  found  that  he  could 
readily  identify  them.  The  operator  was  able  to  do  this  by  recognizing  the  target’s  distinct  shape 
and  the  absence  of  the  irregularities  characteristic  of  the  background  pattern. 

The  opaque  target  itself  does  not  adequately  simulate  real  world  situations  since  it  is  unlikely  to 
find  military  vehicles  uncamouflaged.  However,  it  is  not  unlikely  to  find  military  vehicles  imperfectly 
camouflaged.  We  recognized  that  the  TVansparent  targets  represented  the  best  possible  camouflage 
and  the  Uniform  Opaque  targets  represented  the  worst  possible  camouflage.  We  therefore  decided 
to  use  a  Uniform  Opaque  target  camouflaged  with  a  target  sized  background  pattern  in  an  attempt 
to  simulate  the  case  of  a  well  but  imperfectly  camouflaged  target.  Again  using  the  military  vehicle 
example,  consider  a  tank  with  a  hot  engine.  The  tank  crew  attempts  to  camouflage  using  camouflage 
paint,  netting  and  some  type  of  material  to  break  the  outline  of  the  vehicle  (such  as  dead  foliage, 
hay  or  burlap).  The  crew  positions  the  tank  in  some  naturally  concealed  position.  It  is  unlikely  that 
the  crew  can  find  a  position  such  that  the  natural  IR  signal  of  the  background  perfectly  matches 
the  IR  signal  of  the  tank.  The  tank  absorbs  the  background  heat  from  the  environment  and  emits 
heat  from  its  engine.  The  camouflage  paint,  netting  and  foliage  provide  pattern  irregularities  that 
help  the  tank  to  blend  with  the  background.  The  ability  of  the  crew  to  successfully  match  the 
background  IR  pattern  depends  on  many  factors  (i.e.,  crew  skill,  natural  camouflage,  preparation 
time,  etc).  The  best  the  crew  can  do  is  nearly  perfectly  match  the  background. 

If  the  crew  imperfectly  camouflages  the  vehicle  then  the  IR  signal  given  off  by  the  tank  appears 
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as  the  uniform  IR  energy  from  the  tank’s  engine,  the  mean  background  IR  energy,  and  the  IR 
energy  from  the  camouflage.  The  crew’s  camouflage  attempts  break  up  the  uniform  signal  but  can 
not  completely  disguise  it.  The  camouflage  adds  additional  non-uniform  signal  which  is  close  but 
imperfectly  matched  to  the  background  IR  pattern.  The  above  mentioned  “Opaque-Camouflaged” 
targets  represent  this  case.  In  the  “Opaque  Camouflaged”  situation  we  randomly  selected  the  target 
camouflage  pattern  from  some  place  in  the  background.  Sometimes  this  camouflage  matched  the 
background  nearly  perfectly  (a  good  crew)  and  sometimes  it  did  not  (a  poorly  trained  crew).  We 
thought  this  situation  fairly  represented  an  imperfectly  camouflaged  target. 

In  the  previous  sections  we  discussed  the  terminology  and  data  presentation  techniques  the 
reader  needs  to  understand  the  experiments.  This  terminology  will  be  used  to  describe  the  experi¬ 
ments  and  the  associated  theory.  The  next  chapter  discusses  some  of  this  relevant  theory. 
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III.  SUPPORTING  THEORY 

This  section  introduces  the  theory  relevant  to  the  research.  We  will  discuss  the  theory  we 
consider  essential  to  understanding  the  key  aspects  of  the  thesis.  This  section  includes  a  discussion 
of: 

1.  Statistically  reliable  experiments  and  the  number  of  trials  required. 

2.  The  definition  and  properties  of  linear  filters. 

3.  Maximum  SNR  and  optimum  linear  filtering. 

A.  STATISTICALLY  RELIABLE  EXPERIMENTS 

The  first  point  of  theory  discusses  the  process  we  used  in  determining  the  number  of  trials* 
necessary  for  each  experiment  to  reliably  determine  probability  of  detection,  probability  of  false 
alarm  and  SN Reff  •  We  wanted  to  make  sure  we  ran  enough  trials  in  each  experiment  so  that  when 
we  calculated  a  value  for  5AReff  the  rms  error  associated  with  this  value  would  not  be  large  relative 
to  the  value  itself  and  thus  make  the  result  unreliable.  We  decided  that  the  rms  error  should  be  no 
more  than  about  fifteen  percent  of  the  “correct”  answer. 

We  evaluated  the  relationship  between  number  of  trials  and  the  standard  deviation  of  the 
experiment’s  results  for  the  5AReff  using  Monte  Carlo  techniques.  In  this  Monte  Carlo  process  we 
replaced  the  detailed  procedure  for  each  trial  of  determining  the  presence  of  a  target  with  a  randomly 
made  choice  of  whether  or  not  a  mistake  weis  made.  The  random  choice  was  made  in  a  way  that 
reflected  some  expected  (Po,PFA)-pair.  The  choice  of  this  expected  (PD,PFA)"P^ir  was  somewhat 
arbitrary  and  reflected  our  desire  to  achieve  a  convenient  to  work  with  detection  probability  and 
false  alarm  probability  (i.e.,  values  not  too  close  to  zero  or  one).  The  (PdjRfa)  values  that  we  used 
where  chosen  to  correspond  to  a  SNR  between  one  and  five. 

We  then  set  up  a  simulation  based  on  some  number  of  trials  which  we  considered  using  in  an 
experiment.  A  result  was  randomly  chosen  for  each  of  these  trials.  This  result  was  either  chosen 
to  be  correct  or  incorrect  in  proportion  with  the  selected  probabilities  (PdiRfa)-  The  program  first 
took  the  set  of  reports  from  the  simulated  trials,  then  calculated  the  experiment’s  Monte  Carlo 
(P[5,PpA)-pair  —  and  from  that  calculated  an  SNRefiioT  a  simulated  experiment. 

That  simulated  experiment  was  repeated  many  times  and  from  the  results  of  those  many  trials 
we  obtained  a  number  of  SAPeff  estimates.  Prom  these  many  SAPeff  estimates  we  determined  a 
standard  deviation  to  be  associated  with  a  SNR  estimate.  Having  decided  that  an  rms  deviation 

*  Note  when  we  use  the  word  trial  we  mean  a  single  detection  event. 
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of  15  percent  of  the  SN Red  was  a  satisfactory  result,  if  the  standard  deviation  obtained  with  the 
simulation  was  not  within  15  percent  of  the  SNRef^we  repeated  the  experiment  with  an  increased 
number  of  trials  in  the  Monte  Carlo  simulation. 

We  repeated  this  process  for  different  numbers  of  trials  (50  trials  to  500  trials)  with  {Pd,Pfa)- 
pairs  chosen  to  correspond  to  SNR’s  of  1,2, 3, 4, 5.  In  doing  this  we  were  conscious  of  the  fact  that 
if  we  asked  the  operator  to  perform  too  many  trials,  then  human  factors  (boredom  and  annoyance) 
might  unduly  influence  the  experiment.  We  knew  from  experience  that  the  operator  could  perform 
about  40-60  trials  in  an  hour  and  expected  that  the  longest  the  operator  would  be  able  to  maintain 
his  concentration  was  about  eight  hours.  We  therefore  felt  that  500  hundred  trials  was  the  absolute 
maximum  number  of  operator  trials  for  any  experiment.  We  never  ran  an  evaluation  for  a  larger 
number  of  trials. 

Shown  in  Table  1  is  a  summary  of  the  Monte  Carlo  simulation  results.  We  decided  to  use  a 
SNReRof  3  and  200  experimental  trials.  We  accepted  an  rms  error  of  14  percent. 

The  results  shown  in  Table  1  indicate  that  for  a  nominal  SNR  of  5.0  the  estimated  SNR  tends 
to  be  biased  negatively,  more  so  the  smaller  the  number  of  trials.  Even  for  a  nominal  SNR  of  4.0 
this  bias  was  present  at  a  significant  level  unless  we  used  more  than  100  trials.  For  our  choice  of 
a  nominal  SNR  of  3.0  with  200  trials  there  does  not  appear  to  be  any  bias  problem.  We  also  note 
from  consideration  of  Table  1  that  for  200  trials  we  will  have  close  to  15  percent  error  whether  the 
nominal  SNR  is  2. 0,3. 0,4.0  -  so  we  do  not  have  to  be  too  concerned  about  the  exact  selection  of 
signal  strength  to  match  the  nominal  SNR  value  of  3.0. 

We  concluded  from  this  that  we  could  obtain  satisfactory  results  if  we  ran  two  hundred  trials  in 
each  operator  experiment.  (The  two  hundred  trial  figure  was  used  only  for  the  experiments  with  the 
human.  For  the  experiment  with  the  machine/filter  we  had  no  comparable  constraint  on  how  many 
trials  we  could  run.  For  the  machine/filter  part  of  each  experiment  we  ran  ten  thousand  trials.) 

In  setting  up  the  actual  experiments  we  could  not  explicitly  choose  the  SNR  to  match  that  in 
the  table.  Instead  we  simply  guessed  at  a  suitable  signal  strength  and  ran  a  small  number  of  trials 
with  a  human  and  collected  {Pu,Pfa)  data  from  which  a  coarse  estimate  of  S N ReH  was  found.  We 
then  accordingly  adjusted  the  signal  strength  and  repeated  the  experiment.  After  a  few  experiments 
we  converged  on  a  suitable  signal  strength.  This  signal  strength  was  then  used  for  both  the  two 
hundred  operator  trials  and  the  ten  thousand  trials  for  the  machine/filter. 
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SNR„„,  SNR.rf  STDSNR  #trials  %  dev 

1.0000  1.0417  0.5509  50.0000  0.6920  0.3080  55.0905 

2.0000  2.0860  0.6225  50.0000  0.8404  0.1596  31.1245 

3.0000  2.8879  0.5519  50.0000  0.9178  0.0822  18.3974 

4.0000  3.3172  0.3439  50.0000  0.9487  0.0513  8.5978 

5.0000  3.4451  0.1951  50.0000  0.9567  0.0433  3.9022 

1.0000  1.0142  0.3772  100.0000  0.6908  0.3092  37.7221 

2.0000  2.0521  0.4536  100.0000  0.8415  0.1585  22.6817 

3.0000  3.0739  0.5447  100.0000  0.9311  0.0689  18.1567 

4.0000  3.7504  0.4202  100.0000  0.9666  0.0334  10.5039 

5.0000  4.0113  0.2393  100.0000  0.9767  0.0233  4.7862 

1.0000  1.0123  0.3108  150.0000  0.6915  0.3085  31.0778 

2.0000  2.0330  0.3637  150.0000  0.8414  0.1586  18.1870 

3.0000  3.0738  0.4794  150.0000  0.9327  0.0673  15.9787 

4.0000  3.9326  0.4518  150.0000  0.9724  0.0276  11.2950 

5.0000  4.3077  0.2558  150.0000  0.9836  0.0164  5.1161 

1.0000  1.0072  0.2657  200.0000  0.6912  0.3088  26.5662 

2.0000  2.0252  0.3134  200.0000  0.3414  0.1586  15.6719 

3.0000  3.0644  0.4137  200.0000  0.9334  0.0666  13.7892* 

4.0000  4.0062  0.4681  200.0000  0.9744  0.0256  11.7036 

5.0000  4.4853  0.2862  200.0000  0.9867  0.0133  5.7244 

1.0000  1.0060  0.2372  250.0000  0.6913  0.3087  23.7238 

2.0000  2.0263  0.2751  250.0000  0.8422  0.1578  13.7526 

3.0000  3.0521  0.3693  250.0000  0.9334  0.0666  12.3096 

4.0000  4.0453  0.4610  250.0000  0.9757  0.0243  11.5250 

5.0000  4.6112  0.3079  250.0000  0.9886  0.0114  6.1584 

1.0000  1.0033  0.2187  300.0000  0.6910  0.3090  21.8702 

2.0000  2.0190  0.2529  300.0000  0.8417  0.1583  12.6474 

3.0000  3.0428  0.3308  300.0000  0.9334  0.0666  11.0253 

4.0000  4.0712  0.4575  300.0000  0.976  0.0235  11.4387 

5.0000  4.7057  0.3290  300.0000  0.9898  0.0102  6.5793 

1.0000  1.0022  0.1997  350.0000  0.6910  0.3090  19.9726 

2.0000  2.0138  0.2334  350.0000  0.8414  0.1586  11.6711 

3.0000  3.0321  0.3038  350.0000  0.9331  0.0669  10.1254 

4.0000  4.0701  0.4427  350.0000  0.9767  0.0233  11.0664 

5.0000  4.7788  0.3402  350.0000  0.9907  0.0093  6.8031 

1.0000  1.0031  0.1858  400.0000  0.6913  0.3087  18.5840 

2.0000  2.0133  0.2193  400.0000  0.8415  0.1585  10.9668 

3.0000  3.0274  0.2798  400.0000  0.9331  0.0669  9.3251 

4.0000  4.0779  0.4240  400.0000  0.9771  0.0229  10.5998 

5.0000  4.8370  0.3527  400.0000  0.9913  0.0087  7.0535 

1.0000  1.0040  0.1752  450.0000  0.6915  0.3085  17.5158 

2.0000  2.0099  0.2051  450.0000  0.8413  0.1587  10.2564 

3.0000  3.0230  0.2682  450.0000  0.9330  0.0670  8.9388 

4.0000  4.0690  0.4023  450.0000  0.9771  0.0229  10.0564 

5.0000  4.8782  0.3633  450.0000  0.9918  0.0082  7.2651 

1.0000  1.0018  0.1656  500.0000  0.6912  0.3088  16.5635 

2.0000  2.0097  0.1922  500.0000  0.8414  0.1586  9.6123 

3.0000  3.0226  0.2561  500.0000  0.9331  0.0669  8.5362 

4.0000  4.0631  0.3864  500.0000  0.9771  0.0229  9.6611 

5.0000  4.9177  0.3692  500.0000  0.9922  0.0078  7.3837 


Table  1.  Table  Of  Monte  Carlo  Simulations.  The  above  figure  .shows 
the  relationship  between  the  nominal  signal-to-noise  ratio 
(SNRnon,),  the  effective  signal-to-noise-ratio  (SNRgff)  ,  the 
deviation  of  snrnom  (STDSNR),  the  number  of  trials  (#  trials), 
the  effective  PD  (PD^jj)  ,  the  effective  PFA  (PFA^ff),  and  the 
standard  deviation  expressed  as  a  percent  (%  dev) .  In  our 
experiments  we  used  SNRnoi„=3.0,  and  200  trials  (this  row  is  marked 
with  an  asterisk) .  We  accepted  about  a  14%  standard  deviation  in 
the  estimate  of  SNR^ff  that  an  experiment  will  produce. 


35 


B.  THE  LINEAR  FILTER 

The  second  point  in  the  theory  that  I  will  discuss  concerns  the  concept  of  a  linear  filter.  The 
basic  property  of  a  linear  filter  is  that  when  it  operates  on  two  signals  added  together  it  produces 
a  result  equal  to  the  sum  of  what  it  produces  when  acting  on  each  signal  separately.  This  is  shown 
below  with  F{...)  denoting  the  filter  and  X,  Y  denoting  the  two  signals.  If  F  is  a  linear  filter  then 

F{X +  Y)  =  F{X)  + FiY).  (1) 

As  a  corollary  we  also  have  that  if  a  is  a  scalar  constant  then 

F{aX)  =  aF{X).  (2) 


It  may  be  seen  from  this  that  in  linear  filter  processing  of  a  signal  the  “significance”  assigned 
to  any  portion  of  the  input  signal  in  forming  the  output  can  not  depend  on  the  value  of  any  other 
portion  of  the  input  signal.  (This  follows  from  the  recognition  that  we  may  consider  the  two  portions 
of  the  input  signal  to  constitute  two  separate  signals  X  and  Y  which  when  added  together  as  X  +  Y, 
form  the  actual  input.  Clearly  the  value  of  one,  say  Y,  cannot  influence  how  we  treat  the  other 
value,  namely  X.)  It  thus  follows  that  a  linear  filter’s  output  may  be  expressed  as  a  weighted  sum  of 
the  input  values.  If  the  input  signal  is  a  sequence  of  sample  values,  Aj  where  i  is  (...—2,  —1,  0, 1,2,...) 
then  the  sequence  of  filter  output  sample  values  ,  Xk,  may  be  written  as 

OO 

Xk=  (3) 

j=—oo 

where  the  set  of  values,  Fj,  is  the  set  of  weighting  factors  which  define  the  filter. 

Going  from  the  discrete  to  the  continuous  we  can  then  write  that  if  the  input  signal  is  a  function 
of  some  variable,  say  of  time  t,  and  so  is  expressible  as  X  (t),then  the  continuous  output  of  the  filter, 
X{t),  is  given  by  the  expression 

/OO 

dt'  F{t')X{t-t').  (4) 

•OO 

This  is  the  spatial  domain  (or  time  domain)  convolution  version  of  the  linear  filter  process. 

Eq.  (4)  represents  the  convolution  of  the  filter  function,  F(£),  with  the  function  X{t)  . 

With  suitable  use  of  Fourier  transforms  an  alternative  form  of  the  filtering  process  can  be 
written. 


dt  exp{—2-Kift)F{t), 
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Xif)^ 

poo 

1  dt  exp(— 27ri/t)  X  (t) 

f  —  OO 

F{t)  = 

pOO  ^ 

/  df  exp(2TTift)  F{f), 

1  —  OO 

X{t)  = 

pOO  ^ 

/  df  exp(2Trift)  X{f). 

1  —  00 

Eqs.  (5)  are  the  mathematical  expressions  for  the  Fourier  transforms  and  the  inverse  Fourier  trans¬ 
forms  in  the  time  and  frequency  domains,  respectively  .  We  use  the  tilde  notation,  as  in  X{f),  to 
denote  the  Fourier  transform  of  the  function,  in  this  case  X  (t).  The  alternative  form  of  the  filtering 
process  is  derived  next. 

The  repeated  Fourier  transform  is  known  to  have  the  property  that  for  any  well-behaved  function 
G{p)  we  can  write 


G(p)  = 


dp'  dqexp{±2Ttiq{p  —  p'))G{p). 


(6) 


We  will  use  Eq.  (6)  in  the  derivation  without  offering  proof.  Replacing  F{t)  and  X{t  —  t')  with  the 
associated  Fourier  transforms  in  Eq.  (4)  we  get 


/OO  rOO  poo  _  _ 

dt'  d/ exp(27ri/t')  /  df' exp{2%if' {t  -  t'))F{f)X  {/') 

•OO  J  —  oo  J—oo 

/OO  poo  poo  _  _ 

df  /  df'  dt' exp(27rz(/'f  — /'f' 4- /f'))F(/)X(/') 

•OO  J  —  oo  J  —  oo 

/OO  pOO  pOO  ^ 

df  df'  dt' exp(27rit'(/-/'))exp(-27ri/'t)F(/)X(/') 

OO  J  —  oo  J  —  oo 

/OO  ^  ^ 

df  F  if  )X  if)  exp(27rz/t). 

•OO 


(7) 


Eq.  (7)  is  the  frequency  domain  version  of  the  filter  process  for  a  linear  filter,  where  F(/) 
represents  an  alternate  form  of  definition  of  the  filter  function,  the  frequency  domain  version 
of  the  filter  function.  It  is  equal  to  the  Fourier  transform  of  the  weighting  factor  or  convolution 
version  of  the  filter  function,  F(t). 
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C.  THE  OPTIMUM  LINEAR  FILTER 


This  next  section  discusses  the  optimum  linear  filter.  An  optimum  linear  filter  operates  on  a 
signal  in  such  a  manner  as  to  produce  the  highest  possible  SNR  that  any  linear  filter  can  provide.* 

It  is  our  aim  in  this  section  to  develop  an  expression  for  the  optimum  linear  filter.  For  simplicity 
we  will  develop  the  expression  in  one  dimension.  The  extension  of  this  proof  to  two  dimensions  is 
straight  forward;  it  only  requires  a  bit  more  algebra. 

We  intend  to  represent  the  signal  as  S{t).  Both  the  target  and  the  background  contribute  to 
the  total  signal  such  that 

S{t)  =  s{t)  +  n{t).  (1) 

Here  s{t)  is  the  target  signature  and  n{t)  is  the  background  signal.  n{t)  can  be  considered  to  be 
equal  to  a  random  function  of  unit  rms  amplitude,  u(t),  multiplied  by  a  scaling  constant,  No,  so  we 
have 


n{t)  =  Noi/(t).  (2) 

The  function  i/{t)  has  the  following  properties  and  associated  quantities. 

*  In  order  to  organize  nomenclature  for  the  reader’s  easy  reference  we  list  here  the  terms  required  for  this  proof. 

P(t)  =  One  dimensional  representation  that  describes  a  target, 

P(f)  =  Fourier  transform  of  P(t), 
s(t)  =  So  P(t  —  to);  Target  signature, 
s(f)  =  Fourier  transform  of  s(t), 
n(t)  —  Noise  associated  with  the  target  signal, 

Ti(/)  =  Fourier  transform  of  n(t), 

P(t)  =  Linear  filter, 

F(/)  =  Fourier  transform  of  P(t), 

Pop(t)  =  A  linear  filter  which  we  will  prove  is  optimum, 

Fopif)  =  Fourier  transform  of  Pop{t), 

SF(t)  =  Filter  that  consists  of  functions  orthogonal  to  Fop{t), 

SF(f)  =  Fourier  transform  of  SF{t), 

S(t)  =  Filtered  background  &:  target  signal  in  the  time  domain, 

s(t)  =  Filtered  target  signal  in  the  time  domain, 

n(t)  =  Filtered  background  noise  signal  in  the  time  domain, 

r'(f)  =  Function  of  unit  strength  which  describes  the  background  characteristics, 

uif)  =  Fourier  transform  of  u(t), 

No  =  Weighting  factor  which  when  multiplied  by  i>{t)  describes  the  background, 

Cv{t)  =  Covariance  of  the  background  signal, 

3>i/(/)  =  Power  spectral  density. 
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1.  Its  ensemble  average  is  zero,  so  we  can  write 


From  this  it  can  be  seen  that 


(u{t))  =  0. 
(n(t))  =  0. 


2.  Its  Fourier  transform  is  expressed  as 

/OO 

dt  exp{~2iTift)  v{t)  . 

•OO 


that 


(3) 

(4) 

(5) 

(6) 


/OO 

dt  exp{—2Trift)n(t). 

■OO 

3.  It’s  characterized  by  the  correlation  function  with 

Cuit)  =  (t'it  —  (7) 

4.  It  has  a  power  spectral  density,  4»^(/),  which  is  the  Fourier  transform  of  Cy{t),  so  that 


(8) 

(9) 


dt  exp(— 27ri ft)  (t). 

J-oo 

We  will  let 

s{t)  =  So  P{t  —  to), 

represent  the  signature  of  the  target.  Here  P(t)  describes  the  normalized  target  signal  form.  It’s 
normalization  is  expressed  as 

/OO 

dt|P(t)|2=l.  (10) 

■OO 

It’s  Fourier  transform  is 

/OO 

dt  exp{—2xift)  P{t).  (11) 

•OO 

The  quantity  5o  may  be  considered  to  be  a  measure  of  the  target  signal  strength,  and  to  may 
be  considered  to  define  the  target’s  “location/position”  ,  or  time  of  occurrence.  The  frequency 
transform  of  the  signal  can  be  written 

/OO 

dt  exp(— 27ri/t)  s{t) 

•OO  * 

dt  exp{—2xift)  So  P{t  —  to) 


/OO 

dt  exp{—2xift)  P(t  —  to) 

•OO 

/OO 

dt  exp(— 27ri/f)  P{t  —  to)  exp(27ri/to)  exp(— 27ri/to) 

•OO 

/OO 

dt  exp(— 27ri/(t  —  to))  P(t  —  to)  exp(— 27ri/to)  . 

•OO 


(12) 
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We  shall  let  t'  =  {t  —  to),  and  with  that  we  have  dt’^^dt.  This  allows  us  to  write 


/OO 

dt'  ex]){—2ivift')P{t') 

•OO 

=  5oexp(-27ri/to)  P(/). 


(13) 


We  can  now  write 


5(/)=  /  dt  exp{—2nift)  S{t) 

J  —  OO 

/OO 

dt  exp{—2nift)  [s(t)  +  n(t)] 

•OO 

=  T(/)  +  u(/).  (14) 

We  have  expressions  for  the  background  and  target  signal  Eqs.  (2),  (6),  (9),  and  (13)  —  and 
the  associated  Fourier  transforms.  We  next  develop  an  expression  for  filtered  signal.  The  filtered 
signal,  which  we  denote  by  S{t),  can  be  written  in  accordance  with  Eq.  (14)  as 

/OO  ^ 

df  exp(27rz/()F(/)5(/) 

•OO 
0 

df  exp{2Trift)  F{f){I{f)  +  n(/)] 


-L 


-OO 

/OO  ^  POO  ^ 

df  QX^{2'Kift)  F {f)s{f)  +  df  exY>{2nift)  F{f)n{f). 

•OO  J  —  OO 


(15) 


If  we  write: 


then  we  get 


/OO  ^ 

df  exp{2irift)  F{f)s{f), 

•OO 

/OO  ^ 

df  exp{2nift)  F{f)n{f), 

•OO 

S{i)  ~  s(t)  +n{t). 


It  is  easy  to  see  that  the  expected  value  of  the  filtered  signal  taken  at  time  to  is 


and  from  Eq.  (4)  have  (^n{to))  =  0,  so 


5(to)  =  s(to)  +n(to), 

(S{to)}=  (s(to)> 

=  s{to). 


(16) 


(17) 


(18) 


(19) 
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This  allows  us  to  write  for  the  random  noise 


|n(to)|  =  |5(to)  -  s{to)\. 


(20) 


so  that  the  mean  square,  or  noise  power,  is: 

(|n(to)P>-<|5(to)  (21) 


Since  the  mean  signal  power  is 

(Sito)f 


(22) 


the  signal-to-noise  power  ratio,  SNRp,  is: 


(Sito)f 

(l«(lo)P) 

mtor 

(|n(to)P>. 


(23) 


We  are  now  ready  to  consider  the  form  of  our  filter.  We  work  with  a  linear  filter  which,  in 
frequency  domain  form  we  shall  denote  by  F{f).  Our  objective  is  to  choose  a  filter  form  which 
maximizes  the  signal-to-noise  power  ratio,  SN Rp.  We  intend  to  show  that  the  optimum  filter  is  of 
the  form 


Fopif)  = 


P*{f) 

^M) 


(24) 


But  for  the  moment  we  simply  condider  this  to  be  some  “arbitrarily”  chosen  filter  form  with 
no  established  virtue.  We  will  do  our  analysis  considering  a  more  general  filter  form,  namely 


F{f)  =  Fopif)  +  ^F{f).  (25) 

We  intend  to  show  that  when  <5F(/)  =  0  the  filter  F(/)  provides  the  largest  possible  value  for  SNRp. 
This  will  show  that  Fopif)  1®  Ih®  optimum  filter. 

Before  proceeding  any  further  with  the  analysis  we  need  to  take  note  that  if  Fopif)  has  some 
particular  virtue  as  a  filter  then  so  does  (1  +  a)Fopif)  •  [  For  the  latter  the  output  signal  is  larger 
by  a  factor  of  (1  -1-  a)  ,  but  so  is  the  rms  noise  in  the  output.  Therefore  the  signal-to-noise-ratio  is 
unchanged  by  the  presence  of  the  factor  of  (1  +  a)  ].  This  means  that  for  our  proof  of  the  optimality 
of  Fopif)  restrict  the  possible  forms  of  SFif)  to  functions  that  are  not  expressible  as  aFopif). 

In  order  to  impose  this  restriction  in  an  analytic  form  it  is  convenient  to  consider  an  orthogonal  set 
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of  functions  one  of  whose  members  is  Fop{f),  and  then  restrict  6F{f)  to  some  weighted  sum  of  all 
the  other  functions  in  this  orthonormal  set.  We  shall  choose  the  orthonormal  set  to  be  orthogonal 
on  the  domain  [—00,  +00]  ,  with  a  weighting  function  corresponding  to  the  power  spectral 

density  of  the  noise. The  orthogonality  of  any  two  functions  in  our  set,  can  be  expressed  as 

The  orthogonality  of  Fop{f)  with  respect  to  all  of  the  other  functions  in  the  set  and  the  fact  that 
6F{f)  is  formed  as  a  weighted  sum  of  all  those  other  functions  means 


/: 


d/F*  (/)£F(/)4>,(/)  =  0. 


(27) 


We  can  write  the  expression  for  the  filtered  signal  at  time  to  as 


s{to) 


df  exp(27rz/to)  Fop{f)  5oexp( 


—  00 
■00 


-2nifto)P{f)  +  J 


df  exp(27ri/fo)  6F{f)  Sq  ex'p{-2TTifto)P{f) 


/OO  pOl  ^ 

df  exp(27rz/(fo  -  to))  Fopif)  SoP(f)  +  df  exp{2nifito  -  to))  6Fif)  5oF(/) 

•OO  J  —  c 

/OO  ^  rOC 

df  Fopif)  SoP  if)  +  df8F{f)SoPif) 

■OO  J  —  OO 


and  since 


df  Fopif  )Pif)  +  So 


/OO 

df6Fif)Pif) 

•OO 


p*if)  =  FopimAf) 

hf)  =  F'opim.if) 


(28) 

(29) 

(30) 


we  can  write 


■/: 


s(to)  =  5o  /  df  F*^if)F^if)^^if)  +  So  J  d/F4(/)5F(/)$,(/)  . 


(31) 


But  remember  the  integral  of  the  optimum  linear  filter  and  the  combination  of  orthogonal  filters  is 


zero 


Therefore: 


/: 


dfF*if)6Fif)^M)  =  0. 


(32) 


=/. 


sito)  =So  I  df  F:pif)Fopif)^M)  +  0 
P*if)Pif) 


--So 

--So 


L 

L 


00 

00 


df^ 

df 


00  ^uiD^vif) 


Mf)- 


(33) 
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This  is  the  numerator  in  our  expression  for  the  signal-to-noise  power  ratio,  SNRp. 

We  next  develop  the  expression  for  average  filtered  noise  the  denominator  in  the  signal-to-noise 
power  ratio  expression.  Starting  from  the  expression  for  the  noise  power  (|h'(to)|^)  given  in  Eq.  (21), 
we  can  write 


(|n(to)|^)  No  J  df  exp(27ri/to)  Fopif)i'if) 


+  ^oj  df  exp(27ri/to)  8F{f)u{f) 


No  J  df  exp{2Ttifto)Fopif)vif) 


/OO  ^ 

df  exp(27ri/fo)  6F{f)u{f) 

■OO 

/OO  ^ 

df'  exp(2nif'to)  Fop{f')v{f') 

•OO 

/OO  ^ 

df'  exp(27ri/'to)  ^F{f')v{f') 

•OO 


+  Afo 


Recalling  the  form  of  Fop{f)  we  have: 


Fop{f)Mf)=P*if)> 
Fopif)*  Mf)  =  Pif)- 


Substituting  this  into  Eq.  (33)  we  get 

{mo)\^)=([NoJ_ 


p*(f)  „ 

No  I  df  exp(27rz/fo)  ~  v{f) 


No 


^u{f) 

/OO  ^ 

df  exp(27ri/to)  8F{f)  7{f) 

■OO 

rOO  P*{f') 

/  df'  exp(27ri/'to)  ~  v{f') 

7-00  ^u{f') 

—  T 

df'  ex.p{2Tcif'to)  6F{f')v{f')'^ 

OO 

Making  double  integrals  of  the  product  of  integrals  we  get. 

(|n(to)|^)  =  No^  j  [  dfdf'  exp  (27ri(/  -  /')<o)  ~  (^(/)^*(/')> 

7-00  7-00  ^u{f)^Af  ) 


Mf) 


/OO  rOO 

/  d/  df'  exp  (27ri(/  -  /')to) 

•OO  J  —  oo 

+No^  [  [  dfdf  exp  (27rf(/  -  /')to)  ^  {^{fVU')) 

J  —  ooJ~oo  } 

/OO  ^OO  ^  ^ 

/  d/d/'  exp  (27ri(/  -  /')to)  6F{f)  6F*if) 

•OO  J  —  oo 


(34) 


(35) 

(36) 


(37) 


(38) 
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It  is  known  that  * 


/CXD 

dtCu{t)  exp(-27ri/t)  ff(/)  = 

•oo 

where  g{f)  is  any  well  behaved  function.  Eq.  (39)  is  now  applied,  yielding  the  result  that 

(|n(to)|2)  =No'^  j  df  +  No^  f  df  P*{f)SF*if) 

J-OO  d>!/(/)  j-oo 


(39) 


+  No 


df  P{f)  SFif)  +  iVo^  /  df  |^F(/)|2$^(/). 


(40) 


We  shall  now,  again  use  Eq.’s  (29)  and  (30)  make  this  substitution  then  take  advantage  of  the 
orthogonality  of  Fop(f)  with  respect  to  all  other  filters  to  determine  that  the  middle  two  integrals 
in  Eq.  (40)  zero.  Thus  the  expression  for  filtered  noise  is. 

{\n{to)\^)  =  No^  f  df^-^^  +  O  +  O  +  No^  f  d/|^F(/)^|$^(/) 

J-OO  J-OO 

=  No^f  df^-^^  +  No^f  df\SFiff\^M)-  (41) 

J-OO  ^u{f)  J-OO 

We  now  have  expressions  for  filtered  signal  and  filtered  noise  and  can  express  the  signal-to-noise 
power  ratio  in  terms  of  Fop(/)  and  the  filters  orthogonal  to  Fopif). 

The  derived  expression  for  the  filtered  signal-to-noise  power  ratio  is: 


SNRp 


[^(^o)P 

(l™(io)P> 


5o 


iL 


df 


\pif)\‘ 

Mf) 


2\2 


No 


L 


df\6F{f)\HM) 


(42) 


For  the  signal-to-noise-ratio  to  be  as  large  as  possible  the  denominator  in  the  above  equation 
has  to  be  as  small  as  possible.  The  smallest  possible  value  for  the  denominator  occurs  when  the 
second  term  is  zero.! 


*  D.L.  Fried,  ’’Spectral  and  Angular  Covariance  of  Scintillation  for  Propagation  in  a  Randomly  Inhomogeneous  Medium", 
Appl.  Opt.  10,  721-731  (1971);  Appendix 

f  This  is  true  because  none  of  the  terms  in  the  denominator  are  negative; 

3’v(/)  is  everywhere  positive, 

|P(/)|2  is  everywhere  positive, 

|^F(/)  |2  is  everywhere  positive. 
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The  second  term  is  zero  when  SF{f)  =  0.  Recall  that  we  began  this  proof  by  examining  a  filter 
combination  which  was  the  sum  of  the  filter  Fop{f)  and  an  orthogonal  filter  .  We  have  just  concluded 
that  this  filter  combination  yields  the  maximum  signal-to-noise  power  ratio  when  the  orthogonal  filter 
is  equal  to  zero.  Therefore  the  filter  combination  which  yields  the  maximum  signal-to-noise  power 
ratio  and  is  the  optimum  filter  must  be  Fop{f)  alone,  which  we  represent  by  writing 


F{f)  =  Fop{f)  +  6F{f)  definition, 

(43) 

6F(f)  =  0  to  maximize  SN Rp  , 

(44) 

F{f)  =  Fopif)  the  optimum  filter  . 

(45) 

This  completes  our  proof. 
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IV.  PRESENTATION  OF  EXPERIMENTS  AND  RESULTS 

This  section  discusses  the  experiments  and  highlights  the  results.  In  three  types  of  experiments 
we  tested  a  human  subject’s  performance  and  a  machine’s  performance  under  a  variety  of  target 
and  background  conditions.  The  three  experiments  are  characterized  as  follows: 

1.  Experiment  1:  Transparent  target  in  Random  White  Gaussian  (RWG)  noise. 

2.  Experiment  2:  Transparent  target  in  SPOT  background. 

3.  Experiment  3:  Camouflaged-Opaque  target  in  SPOT  background. 

All  of  the  experiments  used  a  UNIX  computer  to  generate  pixel  representations  of  a  roughly 
circular  target  in  background  noise.  The  programming  language  was  MATLAB. 

Each  experiment  consisted  of  two  separate  processes.  The  first  process  displayed  pictures  on  the 
computer  monitor  and  was  designed  to  obtain  operator  input.  The  second  process  digitized  image 
data  and  presented  this  data  to  the  machine/filter,  which  applied  the  optimum  linear  filter.  This 
second  process  was  designed  to  test  how  a  machine/ filter  (using  the  optimum  linear  filter)  would 
perform.  At  the  end  of  each  process  the  computer  program  that  was  “responsible”  for  the  conduct 
of  the  experiment  obtained,  and  stored  the  operator  or  machine  data  and  displayed  this  data  on  a 
PRBPRB  graph  for  assessment  of  SNRefj. 

The  operator  process  consisted  of  a  series  of  statistically  independent  trials.  For  each  trial  the 
subject  was  told  the  nominal  location  of  the  target  but  not  whether  the  target  was  actually  present 
in  that  trial.  Thus  the  operator  did  not  have  to  search  for  the  target;  he  only  had  to  decide  if  it 
was  present.  In  each  trial  the  targets  had  a  probability  of  one  half  of  being  present,  but  only  the 
computer  program  conducting  the  experiment  “knew”  for  certain  whether  or  not  the  target  was 
actually  present  in  that  trial.  The  operator  was  subjected  to  no  time  limit  in  deciding  whether  or 
not  the  target  was  present.  In  experiments  one  and  two  the  targets  were  Transparent  so  as  to  achieve 
perfect  blending  of  their  pattern  with  the  background  pattern.  In  experiment  three  the  targets  were 
opaque  and  used  a  camouflage  pattern  that,  while  statistically  equivalent  to  the  blended  background 
pattern,  did  not  smoothly  join  with  the  surrounding  background  at  the  target  edge. 

In  order  to  provide  a  more  operator  friendly  image  display  we  displayed  the  image  in  several 
forms,  side-by-side,  each  with  a  different  gray-scale  rendering.  We  felt  that  showing  more  than  one 
gray-scale  rendering  was  appropriate  since  in  many  real  world  applications  an  operator  could  control 
the  intensity  and  contrast  of  the  display  monitor.  For  instance  a  radar  operator,  or  the  person  viewing 
a  FLIR  display,  generally  has  control  knobs  to  adjust  the  display’s  contrast  and  brightness.  In  our 
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experiments  we  showed  eighteen  different  gray-scale  versions  of  the  target/background  images.  The 
same  image  data  (background  signal  and  target  signal)  was  present  in  each  of  the  eighteen  pictures 
in  the  monitor  display.  Thus  if  a  target  was  present  in  a  given  trial  then  each  of  the  eighteen  pictures 
contained  target  signal,  or  if  the  target  was  not  present  in  a  given  trial  then  none  of  the  eighteen 
pictures  contained  target  signal.  Each  of  the  18  display  pictures  used  a  different  transformation  to 
prepare  the  pixel  values  for  display.  In  making  his  decision  as  to  the  target’s  presence  the  operator 
was  free  to  consider  any  one  (or  even  several)  of  these  eighteen  versions  of  the  image.  In  the 
experiments  the  circular  target  region  had  a  slightly  greater  signature  value  if  the  target  was  present 
than  it  had  when  the  target  were  not  present  (unless  the  target  had  zero  signature,  as  in  Experiment 
3).  The  targets  thus  appeared  slightly  brighter  to  the  operator  than  the  surrounding  background. 

After  we  obtained  the  operator  data  we  ran  the  second  process  which  we  designed  to  measure 
the  machine/filter’s  performance.  We  used  the  same  background  and  target  definitions/parameters 
for  the  machine/filter  as  we  did  for  the  operator.  The  machine/filter  decided  whether  targets  were 
present  or  not  present  based  on  the  filter  output  compared  with  a  threshold  value.  Results  were 
obtained  for  a  variety  of  threshold  values  (actually  for  100  different  threshold  values).  Just  as  the 
operator  knew  where  the  target  would  be  if  it  was  present  we  also  allowed  the  machine  to  have 
this  knowledge.  Accordingly  the  filtered  signal  output  was  taken  only  for  the  single  sample  output 
corresponding  to  the  target’s  nominal  location.  The  target  present/not  present  decision  was  made 
by  the  machine  by  applying  a  threshold  to  this  filter  output  value. 

The  experiments  recorded  both  the  operator  and  machine  data  then  plotted  the  (fb,PFA)-pairs 
on  a  PRBPRB  graph  as  discussed  in  Chapter  I.  Operator  data  was  collected  over  200  trials  leading 
to  a  fourteen  percent  standard  deviation  in  the  SN Reft .  Since  machine  data  could  be  collected  more 
rapidly,  it  was  collected  over  10,000  trials.  Each  (ft),PFA)-pair  plotted  was  computed  using  results 
from  10,000  trials  for  the  machine/filter  or  200  trials  for  the  operator. 
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A.  EXPERIMENT  1:  TRANSPARENT  TARGETS  IN  RANDOM  WHITE 

GAUSSIAN  NOISE 

This  experiment  used  Transparent  targets  in  Gaussian  random  background  noise.  The  target 
region  had  a  slightly  greater  signal  value  if  the  target  was  present  than  when  the  target  was  not 
present.  If  the  target  was  present  it  was  greater  by  the  target  signature  value.  In  the  random 
background  pattern  this  signature  was  not  always  enough  to  provide  a  clear  indication  of  the  target’s 
presence.  An  example  of  the  monitor  display  shown  to  the  operator  is  enclosed  in  Appendix  D. 

We  found  that  the  machine  achieved  a  SNResneatT  the  theoretically  predicted  value  for  a 
linear  filter.  The  operator  very  closely  matched  the  machine/filter’s  performance.  The  operator 
performance  in  this  experiment  seemed  to  lend  credibility  to  our  belief  that  the  operator  can  act  as 
an  optimum  (non-linear)  filter  (see  Fig.  17).  These  experimental  results  were  not  surprising  for  the 
machine/filter  since  a  Gaussian  “white”  background  is  an  ideal  case  for  the  optimum  linear  filter.  In 
this  case  theory  predicts  that  the  machine/filter  performance  will  be  optimal  and  should  correspond 
to  the  GLINE  of  appropriate  signal  strength.  The  best  we  expect  the  operator  to  do  is  match  the 
machine/filter’s  performance.  We  were  somewhat  surprised  by  how  close  the  operator  performance 
did  match  the  machine/filter’s  performance.  As  can  be  seen  in  Fig.  17  the  operator’s  performance 
was  down  from  the  machine  by  less  than  1  dB  (actually  about  0.6  dB).  We  interpreted  this  as  strong 
evidence  that  the  operator  could  act  as  an  optimum  non-linear  filter.  In  this  experiment  we  did  not 
expect  the  optimum  non-linear  filter  (the  operator)  to  outperform  the  optimum  linear  filter.  We  felt 
that  since  the  RWG  noise  had  no  distinguishable  features  the  operator’s  ability  to  process  the  image 
non-linearly  would  not  give  him  any  advantage  over  the  optimum  linear  filter.  We  were  plesisantly 
surprised  by  the  experimental  results. 
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FIGURE  17.  Experiment  1.  The  above  PRBPRB  graph  shows  the 
results  of  the  Experiment  1.  Note  that  the  machine  performs  at 
the  theoretical  effective  signal-to-noise  ratio  of  3.0.  The 
operator's  performance  is  very  close  to  this  value,  lending 
credibility  to  the  assertion  that  the  human  eye/brain  is  an 
optimum  (non-linear)  filter. 
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B.  EXPERIMENT  2:  TRANSPARENT  TARGETS  IN  SPOT  BACKGROUND 


This  experiment  utilized  Transparent  targets  in  non-Gaussian  random  noise.  We  used  SPOT 
images  of  Jacksonville,  Fla.  for  the  background/noise.  We  loaded  these  images  as  gray-scale  rep¬ 
resentations  which  we  displayed  on  the  monitor.  An  example  of  the  monitor  display  with  these 
target/backgrounds  is  displayed  in  Appendix  D.  We  varied  from  where  in  the  scene  we  chose  the 
portion  of  the  background  that  was  used  for  each  detection  trial  so  that  operators  didn’t  become 
familiar  with  what  was  presented.  The  experiment  obtained  (PD,PFA)-pairs  for  the  operator  and 
for  the  machine.  Two  different  machine  filters  were  utilized.  Filter  1  was  the  optimum  linear  filter 
and  filter  2  was  a  matched  filter.  Because  the  background  pattern/noise  had  a  PSD  that  was  not 
constant  the  matched  filter  is  different  from  the  optimum  filter.  Results  for  Experiment  2  are  shown 
for  a  small  diameter  (D=l  pixel,  a  point  target)  in  Fig.  19  and  a  large  diameter  (D=21  pixels)  target 
Fig.  18.  This  experiment  produced  very  interesting  results.  We  found  that  a  human  outperformed 
the  machine  by  a  substantial  amount  only  if  the  machine  used  the  matched  filter.  However,  we 
also  found  that  the  machine  equipped  with  the  optimum  linear  filter  consistently  outperformed  the 
subject  except  when  working  with  the  smallest  targets.  These  results  have  significant  impact.  They 
indicate  that  a  machine  equipped  with  an  appropriate  filter  can  detect  targets  better  than  a  human 
when  the  target  signature  is  well  known.  Automatic  target  recognizers  may  eventually  outperform 
humans  under  the  right  circumstances.  We  want  to  emphasize  that  the  results  of  this  experiment 
contradicted  our  hypothesis.  We  found  no  indication  that  there  was  any  benefit  to  non-linear  pro¬ 
cessing  from  these  results.  Although  our  hypothesis  seemed  to  be  incorrect,  we  saw  the  results  as 
positive  and  potentially  useful.  The  results  clearly  pointed  to  the  merits  of  optimum  linear  filtering. 

We  were  intrigued  by  the  results  of  this  experiment  and  decided  to  analyze  the  optimum  linear 
filter  in  an  effort  to  understand  and  explain  it’s  success.  We  first  examined  the  PSD.  Fig.  20  is  a 
logarithmic  plot  of  PSD  (vertical  axis)  versus  spatial  frequency  (horizontal  axis).  We  noted  that 
PSD  fell  off  rapidly  with  increasing  spatial  frequency.  You  may  remember  that  the  optimum  linear 
filter  divides  the  Fourier  transform  of  the  matched  filter  by  the  PSD.  The  fact  that  PSD  is  much 
larger  at  lower  frequencies  tends  to  deemphasize  the  low  frequency  content  of  the  matched  filter 
and  weight  more  heavily  the  high  frequency  portion.  This  effect  is  something  like  differentiation. 
Dividing  by  frequency  in  the  frequency  domain  is  the  same  as  differentiating  in  the  spatial  domain. 
This  tends  to  emphasize  the  region  in  the  vicinity  of  the  target  edges.  The  Army  Research  Lab  and 
others  (see  Appendix  A)  are  currently  attempting  to  field  an  ATR  using  a  form  of  edge  detection. 
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We  believe  that  work  is  in  a  sense  similar  but  not  the  same  as  optimum  linear  filtering.  We  think 
that  work  may  benefit  from  a  closer  look  at  optimum  linear  filtering  rather  than  thinking  directly 
in  terms  of  edge  detection. 

We  further  examined  the  edge  characteristics  of  the  optimum  linear  filter  by  examining  it’s 
pixel  values  (which  may  be  thought  of  as  filter  weights).  Fig.  21  is  a  three  dimensional  plot  of  the 
optimum  linear  filter  for  a  matched  filter  with  a  diameter  of  21  pixels.  Examine  the  figure  and  you 
will  note  that  the  pixel  value  maxima  are  associated  with  the  edge  region.  To  show  this  more  clearly 
Fig.  22  shows  the  pixel  values  associated  with  the  diagonal  of  the  spatial  frequency  plane.  It  also 
shows  spikes  for  the  pixel  values  corresponding  to  the  filter  edge  region. 

The  results  of  this  experiment  indicate  that  optimum  linear  filtering  may  have  strong  correlation 
to  edge  detection.  We  recommend  that  researchers  doing  edge  detection  work  take  a  closer  look  at 
the  theoretical  basis  for  this  type  of  detection.  We  think  optimum  linear  filtering  is  a  good  place  to 
start. 
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FIGURE  18.  Experiment  2,  Diameter  =  21.  The  above  graph  shows 
the  results  of  Experiment  2 .  The  results  were  obtained  using  a 
target  whose  diameter  was  21  pixels  (a  large  target) .  Note  that 
the  machine  when  equipped  with  the  optimum  filter  significantly 
outperforms  the  operator  at  detecting  these  relatively  large 
targets . 
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FIGURE  19.  Experiment  2,  Diameter=l  (A  Point  Target) .  Note  that 
the  man  and  the  machine/ filter  achieve  equal  performance.  This  is 
significant  because  it  illustrates  that  at  best  the  operator's 
performance  will  equal  the  machine/f liter .  Operator  performance 
even  for  a  very  small  target  signature  did  not  beat  the  machine. 
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FIGURE  20.  Power  Spectral  Density  Plot.  The  above  graph  is  a 
logarithmic  plot  of  the  SPOT  background's  power  spectral  density 
(vertical  axis)  versus  spatial  frequency  (horizontal  axis).  Note 
that  the  power  spectral  density  decreases  rapidly  with  increasing 
spatial  frequency. 


FIGURE  21.  Mesh  Plot  Of  Optimum  Linear  Filter.  The  above  figure 
shows  a  three  dimensional  plot  of  the  optimum  linear  filter.  The 
spikes  correspond  to  pixel  values  and  the  plane  parallel  with  the 
floor  corresponds  to  the  spatial  frequency  axes.  Note  that  the 
pixel  values  are  at  their  maximum  values  from  pixels  15  thru  20 
then  again  from  pixels  35  thru  40.  This  has  the  effect  of 
emphasizing  (applying  a  greater  weight  to)  the  pixels  at  the 
target  edge  region. 


FIGURE  22.  Plot  Of  Pixel  Values  Along  Diagonal.  The  above  figure 
shows  the  pixel  values (vertical  axis)  plotted  against  the 
diagonal  of  the  spatial  frequency  plane.  The  graph  allows  us  to 
approximate  the  number  of  pixels  (horizontal  axis)  associated 
with  some  pixel  value  (vertical  axis) .  Thus  we  can  see  that 
there  are  approximately  six  pixels  associated  with  two  vertical 
spikes  (maximum  filter  weights) .  If  you  look  at  the  horizontal 
axis  you  see  that  these  spikes  occur  at  pixels  (17-20)  and  (31- 
34) .  These  pixels  correspond  to  the  filter  edge  region.  This  plot 
shows  that  the  optimum  linear  filter  applies  the  greatest  filter 
weight  to  the  filter  (and  target)  edge  region. 
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C.  EXPERIMENT  3:  CAMOUFLAGED-OPAQUE  TARGETS  IN  SPOT 


BACKGROUND 

This  experiment  used  camouflaged  targets  in  a  SPOT  image.  We  found  that  the  operator  easily 
recognized  the  targets.  Even  though  the  camouflage  pattern  on  the  target  was  statistically  equivalent 
to  the  nearby  background  pattern,  the  mismatch  between  the  features  in  the  camouflage  pattern 
and  the  adjacent  background  features,  particularly  along  the  target’s  edge  was  a  dead  giveaway. 
Even  with  zero  target  signature  the  operator  was  able  to  reliably  detect  the  presence  of  the  target 
because  of  the  camouflage/edge  mismatch.  This  is  remarkable  performance,  especially  when  we  note 
that  the  machine/filter  has  a  very  poor  ROC  for  the  same  set  of  background  and  target  definitions 
and  parameters.  The  results  of  this  experiment  for  a  signal  strength  of  two  and  of  zero  are  shown 
in  Fig.’s 23  and  24.  The  operator  outperformed  the  machine  in  both  cases.  Shown  in  Fig.  25  is  the 
Camouflaged-Opaque  target, with  zero  signature,  in  SPOT  background.  Note  that  you  can  readily 
identify  the  target  because  it  looks  “different”  than  the  background.  This  target  “looks”  exactly  the 
same  as  the  background  to  the  machine/filter  because  the  camouflage  has  zero  bias  and  the  target 
has  zero  signal.  This  is  why  we  think  non-linear  processors  will  outperform  linear  filters  when  only 
the  statistics  of  the  background  and  target  are  known. 

These  experimental  results  more  closely  match  the  original  hypothesis.  They  provide  strong 
evidence  that  the  operator  is  using  a  non-linear  filtering  process  to  take  note  of  information  which 
the  machine/filter  cannot  use.  The  question  of  what  processing  the  subject  uses  to  recognize  the 
targets  deserves  further  investigation.  It  was  not  pursued  in  this  thesis.  We  think  the  operator  might 
pay  particular  attention  to  (i.e.,  give  principle  weighting  to)  the  target  and  background  camouflage 
match,  particularly  at  the  target  background  boimdary.  We  believe  an  investigation  of  the  decision 
process  that  the  operator  goes  through  in  recognizing  a  target  will  yield  a  high  payoff. 
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FIGURE  23.  Experiment  3,  Signal  =  1.5.  The  above  figure  shows 
the  results  of  Experiment  3 .  In  the  above  experiment  the  target 
had  a  signal  of  2.  The  signal  strength  did  not  seem  to  be  the 
most  important  target  characteristic  for  the  operator.  The 
operator  seemed  to  look  for  the  mismatch  between  the  target  and 
the  background  camouflage.  Note  that  the  operator  outperforms 
the  machine . 
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FIGURE  24.  Camouflage  Opaque  Target  With  Zero  Signal.  Note  that 
the  operator  achieves  a  signal-to-noise  ratio  effective  of  3.1 
with  zero  signal.  The  operator  cannot  be  using  linear  filtering 
because  the  target  and  the  background  have  the  same  signal  and 
therefore  look  exactly  the  same  to  a  linear  filter. 
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FIGURE  25.  Camouf laged-Opaque  Target  With  Zero  Signature.  The 
above  image  shows  a  Camouf laged-Opaque  Target  in  a  SPOT 
background.  This  target  has  zero  signature.  You  can  recognize 
the  disc  shaped  target  by  the  difference  in  target  and  background 
features .  You  take  advantage  of  the  fact  that  the  target 
"doesn't  look  right".  A  linear  filter  cannot  recognize  the 
difference  between  the  target  and  the  background  because  they 
both  have  the  same  signal  level. 
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V.  SIGNIFICANCE 


In  this  chapter  we  discuss  the  thesis  results  and  their  significance.  We  believe  that  the  proposed 
ATR  systems  which  we  know  of  can  benefit  from  our  research  results  and  analysis.  We  make  the 
following  observations  and  recommendations. 

We  recommend  that  ATR  researchers  adopt  comparison  of  the  machine/filter  device  under 
study  with  a  human  operator’s  performance  under  the  same  tar  get /background  characteristics  as 
the  standard  to  evaluate  how  well  the  machine/filter  performed.  We  found  only  one  other  example 
where  this  was  done  in  a  quantitative  sense.  This  is  an  important  approach  and  although  our 
research  indicates  that  a  human  may  not  be  the  best  possible  filter  in  all  situations,  a  system  able 
to  match  human  performance  would  have  many  customers.  An  ATR  as  good  as  a  man  operating 
at  his  leisure  would  be  of  great  interest  and  would  represent  a  significant  enhancement  to  combat 
capability  when  fielded. 

The  methodology  we  adopted  of  associating  (Pd,Pfa)  together  as  a  pair  and  using  this  pair 
to  calculate  an  SNR^fc,  and  then  using  this  SNReSSiS  the  standard  of  comparison  is  unambigu¬ 
ous  and  provides  a  powerful  comparative  tool.  The  research  we  have  read  often  fails  to  associate 
Pd  with  Pfa  when  reporting  system  performance.  Commonplace  statements  such  as  “The  system 
has  demonstrated  its  ability  to  reliably  detect  targets”  together  with  the  remark  that  “The  false 
alarm  rate  needs  to  be  improved”  are  ambiguous  to  the  point  of  being  meaningless.  Any  system 
can  reliably  detect  targets  if  you’re  willing  to  tolerate  the  associated  false  alarms.  The  ATR  com¬ 
munity  should  adopt  the  convention  of  associating  Ppand  Pfa  together  as  a  pair.  The  methodology 
of  reporting  Powith  Pfa  as  a  pair  then  reporting  a  system’s  performance  as  the  Gaussian  equivalent 
signal-to-noise  ratio  (SAPeff)  of  that  (PD,PFA)-pair  may  be  used  to  compare  the  performance  of 
any  two  systems,  or  to  compare  any  system  with  a  human.  * 

We  have  examined  much  work  in  the  ATR  community  which  attempts  to  use  edge  detection  as 
the  underlying  process  for  target  recognition.  The  results  of  this  work  appear  promising.  We  believe 
that  the  optimum  linear  filter  taking  proper  account  of  the  background  represents  the  appropriate 

*  Some  work  may  only  lead  to  a  false  alarm  rate,  PfAj  rather  than  to  a  false  alarm  probability. 
In  such  cases  the  rate  ,  PpA,  should  be  reported  (with  Pq)  and  accompanied  by  a  rough  estimate 
of  the  rate  of  false  alarm  “opportunities,” O.  A  rough  estimate  of  PpA  —  Pfa/^  can  then  be  used 
to  calculate  SNReff.  The  non-linearity  of  the  calculation  of  SN Red  is  such  that  even  an  order  of 
magnitude  error  in  Cl  will  have  only  a  minor  offset  on  the  calculated  value  of  SNReff. 
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form  of  an  edge  detection  algorithm.  We  recommend  that  those  researching  ATR  with  the  edge 
detection  technique  reexamine  the  theoretical  basis  for  this  work  taking  advantage  of  the  similarity 
between  optimum  linear  filtering  and  edge  detection. 

Under  certain  conditions  in  the  case  of  a  well  defined  target  the  optimum  linear  filter  outper¬ 
forms  the  human.  The  circumstances  are  that  the  target  is  known  in  detail  and  in  advance  (in  our 
experiments  simply  that  the  target  was  a  disc  with  well  defined  edges)  and  the  target  does  noth¬ 
ing  to  the  background  scene  except  add  signature  to  it  (i.e.,  the  target  does  not  hide  background 
irregularities).  Under  these  circumstances  the  human  does  not  seem  to  be  able  to  collect  and  to 
assimilate  all  the  edge  information  in  arriving  at  his  decision.  Further  research  should  be  conducted 
to  determine  the  appropriate  background/target  situations  in  which  the  optimum  linear  filter  may 
be  the  most  appropriate  filter. 

We  believe  that  the  greatest  benefit  to  ATR  research  will  come  from  developing  an  understand¬ 
ing  of  human  non-linear  processing  in  target  recognition.  This  research  strongly  indicates  that  a 
non-linear  processor  has  merit  when  there  are  details  in  the  target  which  can  only  be  characterized 
in  the  statistical  sense.  By  this  we  mean  that  you  don’t  know  exactly  what  the  details  of  a  scene 
are,  you  only  have  to  know  something  about  the  statistics  of  that  scene.  This  target  situation  more 
closely  represents  the  type  of  background  environment  in  which  a  fielded  ATR  would  have  to  operate. 
We  think  that  further  research  in  the  non-linear  process  will  yield  a  significant  payoff. 
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APPENDIX  A.  CURRENT  ATR  RESEARCH 

The  search  for  automatic  target  recognizers  (ATR)  began  three  decades  ago  in  the  1960’s.  Today 
there  are  Army,  Navy,  and  Air  Force  as  well  as  various  commercial  programs.  Each  service  recognizes 
the  military  significance  of  a  viable  automatic  target  recognizer.  Desired  Army  applications  are: 

1.  Target  Aquisition  for  attack  helicopters  and  air  defense  systems. 

2.  Target  aquisition  for  tank  and  anti-armor  systems. 

3.  Target  aquisition  for  observed  indirect  fire. 

4.  Minefield  detection. 

Desired  Navy  applications  are: 

1.  Ocean  surveillance  and  targeting. 

2.  Antiship  missile  recognition. 

3.  Land  attack  weapon  guidance,  control,  and  target  acquisition. 

4.  Air  target  recognition. 

Desired  Air  Force  applications  are: 

1.  High  value  deep  target  recognition. 

2.  Cruise  missile  advanced  guidance. 

3.  Autonomous  SAR  guidance/target  recognition. 

4.  Image  analyst  work  station  data  reduction  on  airborne  intelligence  platforms.  As  an  emerg¬ 
ing  technology  ATR  research  is  wide  open  to  different  problem  solving  approaches.  ATR 
strategies  vary  widely.  Some  of  these  strategies  are  listed  below: 

1.  Multi-sensor  aided  targeting.  Intended  principally  for  airborne  use,  this  approach  attempts 
to  use  the  significant  advantages  of  high  SNR  active  radars  with  advanced  algorithms  and 
neural  networking,  generally  in  conjunction  with  a  FLIR  sensor. 

2.  Target  azimuth,  range,  elevation  and  intensity.  This  approach  attempts  to  use  target  loca¬ 
tion,  and  signature  intensity  information  provided  by  other  sources  for  target  recognition. 

3.  Edge  detection  and  decision  trees.  This  approach  works  with  optical  sensor  image  data. 
It  compares  the  difference  in  boundaries  between  potential  targets  and  their  backgrounds. 
The  approach  considers  the  edge  as  the  most  important  piece  of  target  information. 
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Regardless  of  the  approach  taken,  the  ATR  under  study  will  produce  some  characteristic  num¬ 
ber  of  correct  responses  (true  detections,  correct  identification  of  no  target  present)  and  incorrect 
responses  (missed  detections,  and  false  alarms).  The  success  of  a  system  can  be  reported  by  specify¬ 
ing  the  number  of  correct  responses  and  the  number  of  incorrect  responses  of  the  system  in  a  given 
target  situation.  We  have  noted  that  the  industry  suffers  from  a  general  failure  to  quantitatively  re¬ 
port  both  the  correct  and  the  incorrect  responses  of  a  system  together.  Perhaps  the  least  ambiguous 
quantitative  measure  of  a  system’s  performance  is  the  (PD,PFA)-pair.  We  prefer  this  technique  and 
recommend  that  whenever  possible  researchers  report  their  results  as  (PD,PFA)-pairs.  The  prob¬ 
lem  seems  to  be  most  acute  for  reporting  Pfa-  We  acknowledge  that  the  problem  with  reporting 
PpAComes  from  the  difficulty  in  determining  “the  number  of  possible”  detections.  For  instance  a  de¬ 
tection  device  that  has  a  one  meter  resolution  examining  a  1,000  m^  area  will  have  fewer  detection 
events  than  a  device  with  ten  centimeter  resolution.  The  number  of  detection  for  either  device  will 
be  related  to  the  method  that  device  uses  to  sample  the  background  data.  We  recommend  that  when 
researchers  find  it  inappropriate  to  report  PpAdirectly  then  they  should  report  the  false  alarm  rate 
for  the  device  using  the  most  unambiguous  units  of  measure  possible.  We  futher  suggest  that  these 
reseachers  should  describe  the  method  used  in  calculating  the  P^Arate  in  the  body  of  the  research 
report  and  describe  in  their  best  estimation  how  that  reported  false  alarm  rate  may  be  correlated 
with  Pfa-  When  reporting  system  results  researchers  should  understand  that  users  are  interested  in 
how  the  system  under  study  compares  with  other  systems  using  the  same  target  situation. 

In  considering  the  measurement  of  an  ATR’s  performance  it  becomes  useful  to  compare  the  ATR 
in  question  with  a  human.  We  have  noted  that  the  overwhelming  majority  of  research  work  seems  to 
use  targets  that  are  easy  for  a  man  to  detect.  The  targets  used  for  ATR  appear  easy  enough  for  a  man 
to  recognize  in  one  rapid  pass.  Dr.  Clarence  P.  Walters  has  examined  this  question.  *  Dr.  Walters 
obtained  the  algorithms  for  a  number  of  ongoing  ATR  projects  and  implemented  these  algorithms  on 
a  computer.  He  then  tested  these  algoritms  against  humans  in  similar  background/ target  situations. 

He  concludes  that  ATR  systems  and  human  observers  detect  targets  with  the  same  probability. 
However  the  ATR  systems  produce  a  false  alarm  rate  that  is  approximately  40  times  that  of*  the 
human  observers.  He  concludes  that  humans  were  able  to  recognize  a  wider  variety  of  targets  because 
they  train  quickly  and  well.  He  states  that  the  ATR  was  able  to  recognize  more  small  low  contrast 

*  Clarence  P.  Walters,  “Human  Perception  Testing  And  Automatic  Target  Recognition:  Performance  Against  A  Common 
Imagery  Set,”  Briefing  to  The  Army  Science  Board  1994,  Paper  for  distribution  to  U.  S.  Government  agencies  and  their 
contractors,  29  June  1993.  Refer  requests  to  AMSEHRD-NV-VISPD-LET, 
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targets  than  the  human  but  that  these  low  contrast  detections  probably  cause  the  systems’  high  false 
alarm  rates.  Dr  Walters  recommends  that  high  quality  field  imagery  should  be  collected  to  train 
and  test  both  ATRs  and  humans  presumably  with  the  intent  of  using  human  performance  as  the 
goal  for  ATR.  We  agree  with  Dr.  Walter’s  proposal.  We  think  that  until  truly  optimal  performance 
standards  predicted  by  generally  accepted  ATR  theories  are  identified  researchers  should  compare 
the  ATR  device  under  investigation  with  human  performance  under  similar  target  and  background 
parameters  and  definitions  to  provide  some  practical  standard  by  which  to  measure  ATR  system 
performance. 

Different  ATR  systems  are  using  different  target /background  situations.  These  situations  vary 
in  complexity  and  difficulty  from  camouflaged  vehicles  in  a  treeline  (very  difficult)  to  planes  on  a 
runway  in  the  open  (relatively  easy).  When  reporting  ATR  results  most  researchers  don’t  discuss 
the  level  of  difficulty  of  the  target/background  situation.  We  recommend  that  the  industry  establish 
a  generally  accepted  method  of  determining  the  relative  difficulty  of  different  target  situations.  We 
think  that  it  would  be  logical  to  judge  this  level  of  difficulty  by  asking  the  question:  “how  well 
would  a  man  perform  using  the  same  target  /background  definitions  and  parameters?”  We  think 
that  researchers  should  report  the  performance  of  their  systems  with  a  discussion  of  the  relative 
level  of  difficulty  of  the  target  detection  problem. 

This  appendix  reviews  some  of  the  current  Automatic  Target  Recognition  (ATR)  work.  The 
sources  for  most  of  the  material  reviewed  came  from  the  Proceedings  Of  the  IMAGE  UNDER¬ 
STANDING  WORKSHOP  13-16  November  1994  and  from  brifings  presented  to  the  ARMY  SCI¬ 
ENCE  board’s  ad  hoc  study  group  on  ATR  in  1994.  When  possible  we  focus  the  review  of 
the  work  being  mentioned  to  target  Probability  of  Detection  (Pu)  and  Probability  of  False  Alarm 
(Ffa)-  Ideally  we  try  to  report  Pd,  Pfa together  as  a  pair  as  we  have  recommended  in  the  thesis  body. 
However  since  most  of  the  reports  of  ATR  research  do  not  address  target  detection  or  false  alarm 
probabilities  directly/quantitatively  we  report  system  performance  given  the  performance  standards 
reported  by  the  researchers  which  are  most  analogous  to  (PD,PFA)-pairs.  Many  of  the  documents 
describing  various  ATR  system  work  neglect  reporting  detection  and  false  alarm  probabilities,  pre¬ 
sumably  because  they  feel  correct  target  classification  implies  target  detection,  or  because  for  the 
system  under  study,  the  authors  plans  to  rely  on  some  other  system  for  target  detection  (cueing). 
We  believe  the  difficulty  of  target  detection  is  imderestimated.  It  seems  to  us  that  reliable  target 
detection  systems  should  be  developed  before  before  focusing  resources  on  target  classification. 
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We  have  found  it  useful  to  group  ATR  work  into  two  broad  approaches.  We  denote  these 
two  approaches  as  statistical  and  intuitive.The  statistical  approaches  include  any  form  of  detection 
whose  methodology  is  dependent  upon  self  adjusting  software  for  recognizing  targets  with  the  self 
adjustment  being  made  using  essentially  a  mathematical/analytic  approach  exploiting  “training” 
data  (in  the  statistical  approach  it  is  the  software  that  is  “trained”).  This  statistical  approach 
includes  neural  arrays  ,  neural  networks,  feature  extraction  algorithms,  correlational  classifiers. 

The  intuitive  approaches  attempt  target  recognition/detection  using  essentially  ’smart’,  or  en¬ 
lightened  ideas  in  the  preparation  of  the  target  recognition  software.  The  “training”  data  is  only 
used  in  evaluation  of  the  software’s  performance-  to  make  the  programmer  aware  of  performance 
problems,  so  that  the  software  can  be  revised  .  In  the  intuitive  approach  it  is  the  programmer  that  is 
“trained.”  The  intuitive  approaches  include  edge  detection,  morphology  matching,  and  some  forms 
of  feature  extraction/comparison. 

Statististical  detection/recognition  depends  upon  extracting  characteristics  of  a  target  region 
then  comparing  these  characteristics  with  values  that  are  expected  for  specific  target  types.  The 
target  and  background  have  different  distributions  of  a  statistic  which  is  used  to  label  each  region 
as  one  of  two  classes.  A  threshold  determines  which  class  a  measurement  a  certain  background 
image  statistic  indicates.  The  statistical  approach  may  be  extended  to  include  many  classes  and 
many  features.  Statistical  approaches  typically  execute  detection  using  multidimensional  distribu¬ 
tion  or  decision  trees.  The  multidimensional  approaches  are  more  accurate  than  the  decision  tree 
approaches,  but  the  decision  tree  approaches  are  less  computationally  intensive. 

We  discuss  a  few  representative  statistical  approaches  next. 


The  US  Army  Missile  Command  is  conducting  work  using  a  passive  multisensor  suite.  *  The  sys¬ 
tem  developers  are  considering  three  supervised  pattern  recognition  approaches.  These  approaches 
are  dynamic  feature/statistical  analysis,  neural  arrays,  and  neural  networks.  In  executing  feature 
analysis  the  researchers  state  that  the  approach  will  limit  the  number  of  features  to  be  considered 
by  applying  the  class  overlap  partitioning  scheme.  This  scheme  feeds  the  image  data  to  a  branch- 
and-bound  procedure  or  to  a  genetic  algorithm  which  then  selects  features  to  be  considered.  The 
set  of  features  selected  is  applied  to  an  appropriate  classifier  where  a  piecewise  linear  computation  is 

*  S.  Richard  F.  Sims  and  M.  Bowles,  “Feature  Analysis  Versus  Neural  Arrays  Versus  Neural  Networks  For  Multisensor 
Target  Recognition,”  Brussels  Sensor  Fusion  Conference  1993. 
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carried  out.  In  the  report  reviewed  the  researchers  claim  the  system  attained  100  percent  separation 
between  targets  and  non-targets. 

The  neural  arrays  reported  used  a  vector  selection  process  and  the  kernels  algorithm  (k-alg) 
to  provide  what  they  call  “exemplars”  of  the  object  to  be  recognized.  The  result  reported  by  the 
researchers  was  a  condensed  target-knowledge  data  base  incorporating  (according  to  their  claims) 
most  of  the  significant  target  attributes  or  features.  The  resulting  set  of  features  was  then  used 
to  create  a  projector  which  they  said  weis  such  that  any  input  vector  if  projected  onto  itself  would 
define  a  target  of  interest.  The  performance  of  the  neural  array  was  reported  as  amplitude  of  output 
for  tanks,  helicopters,  and  clutter.  The  report  stated  that  the  neural  array  does  a  “good  job”  of 
representing  training  data  sets  but  states  that,  as  the  training  data  sets  grows,  then  so  must  the 
computational  requirements. 

The  neural  networks  reported  was  the  multi  layer  perceptron  using  a  new  self  partitioning  neural 
network  (SPNN)  methodology.  The  image  was  feature  mapped  using  a  frequency  transformation 
prior  to  being  fed  into  the  neural  net.  This  network  used  40  input  nodes,  20  hidden  layer  nodes 
and  one  output  layer  node  for  each  target  or  target  class.  Partitioning  is  done  in  one  pass  while 
each  training  image  vector  is  applied  to  the  network.  The  researchers  state  that  no  training  or 
updating  of  the  network  weights  occurs  during  the  conflict  evaluation  pass.  The  errors  from  each 
node  are  propagated  with  the  typical  back  propagation  and  stored  as  an  error  vector.  Each  set  of 
error  vectors  are  then  compared  to  form  a  conflict  matrix.  A  conflict  threshold  is  used  to  determine 
a  clustering  of  the  training  vectors.  The  researchers  state  that  each  cluster  is  used  to  train  individual 
networks  identical  to  the  original  one  used  to  generate  the  error  vectors.  The  researchers  report  that 
the  partitioning  approach  requires  fewer  passes  to  train  the  net  than  other  neural  net  approaches. 
However,  the  designers  can  not  predict  the  number  of  networks  that  can  be  generated  and  thus 
cannot  predict  computational  resources  needed  in  different  situations.  The  researchers  reported 
that  the  neural  network  tested  achieved  100  percent  recognition  in  over  200  iterations. 

The  direction  the  Army  Missile  Command  seems  to  want  to  take  in  the  future  is  to  combine  the 
above  algorithmic  approaches  in  the  same  system  and  use  it  in  conjunction  with  a  human  operator 
in  a  supervisory  role  to  identify  close  range  high  signature  targets. 


The  Davis  Sarnoff  Research  Center  is  investigating  combining  neural  networks  with  pyramid 
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representations  for  target  recognition.*  The  researchers  claim  that  the  relatively  simple  image 
features  produced  using  their  “pyramid”  image  reduction  algorithm  are  more  effective  neural  network 
inputs  than  more  complex  object-tuned  features.  The  system  conducts  a  coarse-to-fine  search,  and 
is  capable  of  context  learning  and  data  fusion.  The  most  succesful  experimental  results  seem  to 
come  from  a  system  that  employs  a  hierarchical  network  capable  of  employing  what  are  termed 
“road  maps.”  As  an  example,  generation  of  a  road  map  from  an  image  may  be  thought  of  as  the 
assignment  of  pixel  weights  to  an  image  by  measuring  the  distance  of  a  region  of  interest  from  a 
fixed  relatively  long  linear  feature.  The  Sarnoff  study  compared  the  pyramid  technique  with  a  similar 
technique  using  eigenfeatures.  They  reported  that  the  pyramid  technique  appears  to  be  more  robust. 
The  initial  results  of  this  research  in  detecting  buildings  in  a  rural  setting  (a  relatively  easy  target) 
were  reported  as  a  ROC  curve  with  true  positives  (as  a  percent)  reported  against  false  positives  (as 
a  percent).  The  (Pd,Rfa) -pairs  thus  reported  ranged  from  (0.85,0.03)  to  (0.94,0.12). 

Neural  Networks  Laboratory  and  the  Illinois  Institute  of  Technology  are  also  researching  a 
neural  network  approach  to  target  detection.*  The  neural  system  consists  of  a  shape  description 
network,  a  geometric  normalization  network,  and  a  recognition  stage  using  what  they  call  fuzzy 
pyramidal  neural  networks.  This  research  uses  two  innovative  approaches.  First  is  a  novel  pyramidal 
architecture  called  “the  vectorial  gradual  lattice  pyramid”  which  is  a  vectorial  space  representation  of 
shape.  Second  is  a  method  to  determine  feature  tokens  called  “cancellation  energy.”  The  cancellation 
energy  approach  uses  directional  information  in  the  vectorial  space  representation  of  shape.  The 
targets  used  in  the  research  appear  to  have  been  aircraft  in  the  open.  The  results  of  the  research 
reported  were  that  the  recognition  rate  was  between  thirty  five  and  one  hundred  percent  depending  on 
the  target  orientation  and  scaling  factor  used.  The  research  also  reports  that  “invariant  recognition 
with  similarity  transforms  as  well  as  moderate  afiine  transforms  are  possible  .”  It  is  noteable  that 
the  research  does  not  mention  measurements  of  false  alarm  rate. 


The  Hughes  Aircraft  Company  is  researching  the  what  they  call  Self  Adaptive  Hierarchical 
Target  Identification  and  Recognition  System  (SAHTIRN).'^  SAHTIRN  applies  a  fast  prescreening 

*  Clay  Spence  et  al.,  “Neural  Network/Pyramid  Architectures  That  Learn  Target  Context,”  Proceedings  of  Image  Under¬ 
standing  Workshop,  Vol.  II,  pp.  853,  November  1994. 

*  Jezekiel  Ben-Arie,  K.  Raghunath  Rao  and  Zhiquian  Wang  “A  Neural  Network  Approach  for  Shape  Description  and 
Invariant  Recognition,”  Proceedings  of  Image  Understanding  Workshop,  Vol.  II,  pp.  863,  November  1994. 

*  Cindy  E.  Daniell  et  al.,  “Artificial  Neural  Networks  for  Automatic  Target  Recognition,”  Proceedings  of  Image  Understand- 
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process  over  an  entire  field  of  regard  to  select  potential  targets  for  further  processing.  SAHTIRN 
then  classifies  potential  targets  as  targets  or  not  targets  (f.e.the  system  does  target  detection).  For 
those  identified  as  targets  SAHTIRN  specifies  the  type  of  target  it  is  (i.e.the  system  does  target 
classification).  The  researchers  claim  that  SAHTIRN  accomplishes  this  using  three  stages  of  neural 
networks.  These  stages  are; 

1.  Segmentation  (forms  coherent  boundaries  out  of  many  individual  local  edge  elements):- 

2.  Feature  extraction  and  pattern  coding  using  what  is  refered  to  as  a  “neocognitron” (A 
hierarchical  feed-forward  system  is  organized  into  several  homogeneous  layers.  Transfor¬ 
mation  between  layers  is  accomplished  by  convolutional  masks,  which  serve  as  connections 
between  neurons.) 

3.  Classification  of  the  specific  target  through  the  use  of  a  back  propagation  learning  rule:- 
(This  back  propagation  procedure  is  implemented  in  a  parallel  computer  that,  in  general, 
having  been  shown  the  appropriate  input/output  exemplars  specifying  some  mapping  func¬ 
tion,  programs  itself  to  compute  that  function.) 

The  study  reported  successful  ATR  performance  when  looking  for  targets  on  a  terrain  board. 

The  test  results  seemed  to  focus  on  correct  target  classification  not  detection.  The  reported  results 
include  probabilities  of  correct  and  missed  classifications  and  probabilities  of  rejection.  Results  for 
the  detection  stage  are  not  reported  in  a  form  that  allows  determination  of  the  values  for  (PD^RFA)- 
pairs. 

HNC  Software  INC  is  researching  many  recognition  approaches  at  least  two  of  which  are  sta¬ 
tistical  and  merit  mention  here.  The  two  approaches  execute  target  recognition  through  “context 
vectors”  *  or  the  k  nearest  neighbors. f  The  context  vector  approach  is  described  as  using  affine 
wavelet  transformations  to  define  a  set  of  image  primitives.  These  primitives  are  treated  as  com¬ 
prising  a  vocabulary  of  image  features.  The  system  is  designed  to  provide  content  address  ability 
of  images  based  on  similarity  of  text  or  images.  The  system  highlights  portions  of  retrieved  images 
that  most  closely  correspond  to  user  queries  then  assigns  index  terms  to  unlabelled  images  based  on 
similarity  of  content  to  a  trained  set  of  images.  No  (FdjRfa)  performance  results  were  provided  for 
ing  Workshop,  Vol.  II,  pp.  853,  November  1994. 

*  Robert  Hecht-Nielson  et  al.,  “Fast  k-NN  Search  for  Robust  ATR  Object  Matching,”  Proceedings  of  Image  Understand- 
ingWorkshop,  Vol.II,pp.  889 

I  William  R.  Caid,  “A  Context  Vector  Approach  to  Image  Indexing  and  Retrieval,”  Proceedings  of  Image  Understanding 
Workshop,  Vol.  II,  pp.  885,  November  1994. 
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the  context  vector  approach.  The  application  is  perhaps  unique  in  that  it  is  stated  it  has  commercial 
applications.  The  system  is  currently  being  studied  for  use  in  text  based  retrieval  systems  such  as 
an  automated  library  retrieval  system. 

The  k  nearest  neighbor  approach  is  designed  to  recognize  partially  obstructed  targets.  In 
this  technique  targets  are  first  defined  by  spatial  frequency  based  feature  vectors.  The  obstructed 
target  feature  vectors  are  then  matched  against  a  large  feature  vector  reference  data  base  to  find 
reference  feature  vectors  with  at  least  fifty  percent  matched  features.  The  matching  algorithm  uses 
a  generalization  of  Euclidian  distance  called  Rousseeuw  distance.  The  system  finds  the  k  nearest 
Rousseeuw  distance  matches  using  a  voting  operation.  This  voting  operation  decides  the  class 
membership  of  the  target.  The  system  requires  very  large  target  databases  and  does  not  address 
target  detection.  No  {Pd,Pfa)  results  were  reported  for  the  k  nearest  neighbor  approach. 


The  US  Army  research  Laboratory  is  investigating  relational  template  matching  (RTM)  for 
target  recognition/detection.*  RTM  uses  a  model  based  multisensor  ATR  algorithm  to  recognize 
military  targets  under  a  variety  of  different  environmental  conditions  with  ranges  to  targets  of  1- 
6  kilometers.  The  researchers  claim  the  ATR  system  applies  an  optimization  methodology  and 
an  ATR  algorithm.  The  optimization  process  (done  once  for  a  given  set  of  targets)  partitions 
and  categorizes  target  signatures.  This  optimization  process  has  a  high  degree  of  computational 
complexity.  The  system  uses  the  relational  templates  to  discriminate  between  target  categories.  A 
recognition  algoritm  compares  aspects  of  a  target  with  known  aspects  of  different  classes  of  targets. 
These  target  aspects  are  found  by  application  of  the  edge  detection  technique.  The  edge  detection 
technique  uses  many  sets  of  probes  (each  probe  being  two  points)  we  believe  taking  advantage  of 
the  theory  that  the  intensity  change  across  a  target  boundary  is  on  average  greater  than  in  the  local 
background.  The  many  values  found  by  the  target  probes  determine  the  target  aspects  which  are 
compared  with  the  known  aspects  of  different  targets.  The  work  reviewed  did  not  reveal  the  results 
of  this  research  in  terms  of  (PD,RFA)-pairs. 

Discussed  next  are  some  intuitive  approaches  to  target  recognition/detection. 


Lincoln  Laboratory  and  MIT  are  researching  what  they  call  The  Experimental  Target  Recog- 
*  Ms  Teresa  Kipp,  “ATR  Relational  Template  Matching,”  Briefing  to  The  Army  Science  Board  1994. 
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nition  System  (XTR5). ^Researchers  claim  XTRS  detects  and  recognizes  armored  tactical  vehicles 
in  registered  range  and  intensity  images  provided  by  ground  based  and  airborne  laser  radars.  They 
say  that  XTRS  can  recognize  very  noisy  images  at  arbitrary  distances  and  orientations.  The  key 
innovation  is  a  generic  matching  engine  that  compares  image  events  (i.e.  silhouettes)  in  the  form  of 
constituent  primitives  to  some  appearance  model  (AM)  hierarchy.  XTRS  consists  of  four  subsystems: 

1.  Event  characterization  describes  the  relevant  features  (image  events  )  of  the  input  imagery. 
Events  are  transformed  into  “range  silhouettes”  using  “edge  detection”  and  “region  seg¬ 
mentation.”  The  report  states  that  the  event  is  decomposed  into  an  “event  primitive” 
which  is  output  to  the  model  library.  In  edge  detection  the  image  event  is  first  cleaned 
(all  isolated  dark  pixels  are  removed)  then  convolved  with  a  difference-of-Gaussian  kernel. 

The  so-convolved  output  is  examined  for  “zero  crossings”  which  correspond  to  the  edges 
in  the  image.  These  zero  crossings  have  characteristic  length,  average  strength.  These 
characteristic  aspects  form  the  event  primitive.  In  range  segmentation  detection  the  image 
event  is  also  cleaned  then  examined  for  interesting  features.  Each  interesting  feature  forms 
an  “interest  image.”  The  interest  image  with  the  most  interesting  aspects  is  selected  and 
contour  outlined  to  form  an  event  primitive. 

2.  The  model  library  contains  the  targets  to  be  recognized  stored  as  Appearance  Models  ( 
AM’s).  AMs  are  descriptions  of  expected  target  appearance  over  a  useful  range  of  aspects. 
Two  different  model  libraries  are  used  depending  on  whether  the  event  primitive  was  gen¬ 
erated  from  edge  detection  or  region  segmentation.  The  event  primitive  is  then  matched 
to  the  model  from  the  model  library. 

3.  Matching  is  the  process  of  comparing  the  extracted  event  and  it’s  constituent  primitives  to 
the  models  in  the  library.  The  same  matching  engine  is  used  for  edge  detection  primitives 
and  for  region  segmentation  primitives. 

4.  Control  orchestrates  the  operation  of  the  other  three  components. 

The  XTRS  system  research  reported  recognition  results  in  terms  of  correct  classification.  The 
report  did  not  specifically  address  target  detection  .  Depending  on  target  type  the  system  reported 
a  65-  98  percent  classification  success  rate. 

The  College  of  Engineering  of  the  University  of  California,  Riverside  is  researching  a  model  based 

t  Jacques  G.  Verly  et  ai.,  “Model  Based  System  for  Automatic  Target  Recognition  from  Forward-Looking  Laser  Radar,” 
Optical  Engineering,  Vol31  No  12,  pp.  2540,  Dec  1992. 
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target  recognition  system  that  uses  a  hierarchical  Gabor  wavelet  representation.*  The  approach 
combines  the  global  and  local  Gabor-based  measures  for  target  indexing  into  a  model  data  base. 
The  ATR  system  uses  the  Gabor  wavelet  to  decompose  target  models  and  image  data  and  a  Gabor 
grid  (which  can  be  thought  of  as  a  topology-preserving  map)  to  efficiently  encode  both  signal  energy 
and  structural  information  of  a  target  in  a  sparse  multi-resolution  representation.  The  system  uses 
a  flexible  matching  mechanism  based  on  the  Gabor  decomposition  and  the  Gabor  Grid.  Gabor 
frequency  is  used  to  estimate  the  scale  variation  of  a  target  from  a  model.  Gabor  magnitude  is  used 
for  probe  matching  based  on  local  structural  energy  patterns.  Gabor  phase  is  used  to  evaluate  the 
matching  result  in  terms  of  average  local  image  displacement  between  the  model  and  the  data.  The 
researchers  report  that  the  system  does  not  rely  on  shape  features  or  contours  for  target  detection 
and  reports  being  tolerant  of  distortions  of  viewing  scale,  aspect,  and  environmentally  induced 
deviations.  The  reported  results  are  that  a  98  percent  recognition  rate  is  achieved  in  207  recognition 
experiments.  The  research  further  reports  tolerating  signature  variations  of  20  degrees  in  depression 
angles  of  22.5  degrees  with  up  to  fifty  percent  occlusion.  No  (Pd,Pfa)  results  are  obtainable  from 
the  report. 


The  Beckman  Institute  for  Advanced  Science  and  Technology  is  researching  a  two  dimensional 
edge  detection  scheme  for  general  visual  processing.*  The  researchers  report  that  the  scheme  con¬ 
structs  a  2D  edge  detection  functional  to  detect  edges  under  the  guidance  of  the  Laplacian  of 
Gaussian  zero  crossing  contours.  They  claim  the  detection  functional  is  optimal  in  terms  of  SNR 
and  edge  localization  accuracy  for  detecting  edges  in  2D  images.  The  researchers  claim  the  detection 
technique  provides: 

1.  An  edge  regularization  procedure  that  enhances  the  continuity  and  smoothness  of  the 
detected  edges  except  at  corners. 

2.  An  adaptive  edge  thresholding  procedure  that  is  based  on  a  robust  global  noise  estimation 
approach  and  two  other  physiologically  originated  criteria. 

3.  A  scale  space  procedure  that  combines  edge  detection  results  from  different  scale  channels 
reliably.  The  researchers  do  not  report  the  performance  of  their  system  in  terms  of  detected 

*  Xing  Wu  and  Bir  Bhanu,  “Target  Recognition  using  Multi-scale  Gabor  Filters,”  Proceedings  of  Image  Understanding 
Workshop,  Vol.I,  pp.505,  November  1994. 

*  Richard  J.  Qian  and  Thomas  S.  Huang, “Optimal  Edge  Detection  in  Two-Dimensional  Images,”  Proceedings  of  Image 
Understanding  Workshop,  Vol.II,  pp.l581,  November  1994. 
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targets  or  edges.  They  offer  three  images  of  what  looks  like  a  sketch  of  a  human  subject 
with  distinct  edge  characteristics  as  evidence  that  the  system  fine  tunes  edge  detection 
results  to  make  them  similar  to  what  is  percieved  by  human  visual  systems. 


In  reviewing  the  literature  related  to  ATR  we  tried  to  compare  the  results  of  the  different 
techniques  in  effort  to  gain  a  quantitative  assessment  of  the  relative  success  of  one  system  to  other 
systems.  We  have  noted  that  this  is  impossible  to  do.  Much  of  the  problem  lies  in  the  relative 
difference  in  the  types  of  targets  each  system  is  designed  to  look  for  and  the  background  clutter 
the  system  designers  tend  to  put  those  targets  in.  We  accept  these  differences  and  understand  that 
target  recognition  performance  is  situationally  dependent.  We  have  also  noted  a  general  failure  on 
the  part  of  ATR  designers  to  report  the  performance  of  their  system  in  terms  of  (PD,RFA)-pairs. 
In  particular  there  is  almost  a  reluctance  to  report  the  performance  of  a  system  in  terms  of  false 
alrm  rate,  and  when  the  false  alarm  rates  are  reported  they  are  often  sufficiently  ambiguous  to  be 
misleading.  We  think  this  is  a  self  defeating  approach  that  fails  to  clearly  present  the  significant  gains 
made  by  the  community  in  the  past  decade,  or  to  clearly  represent  the  operational  capability  of  the 
present  systems  which  may  have  tactical  application  in  a  limitted  scenario  today.  We  recommend 
that  the  industry  study  the  question  of  how  best  to  standardize  the  reporting  of  ATR  performance, 
so  as  to  develop  a  meaningful  way  to  compare  the  techniques  and  systems  being  studied  without 
destroying  the  creativity  needed  in  the  problem  solving  process. 
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APPENDIX  B.  EXPERIMENTAL  DATA 


This  appendix  contains  data  for  Experiments  1,2,3  not  included  in  the  main  body  of  the  thesis. 
This  data  is  displayed  on  probability-probability  (PRBPRB)  graphs  which  are  discussed  in  the  thesis 
main  body  (Chapter  I  Introduction). 
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1.  EXPERIMENTAL  DATA.  EXPERIMENT  1 

The  following  pages  contain  Experimental  data  for  Experiment  1.  The  data  is  shown  as 
PRBPRB  plots  of  an  operator  (PD,RFA)-pair  and  a  matched  filter  (which  in  the  type  of  background 
used  in  these  experiments  is  the  optimum  linear  filter)  ROC. 
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PFA 


FIGURE  26.  Experiment  1  Snrnom=3 ,  Diameter=21 
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2.  EXPERIMENTAL  DATA.  EXPERIMENT  2:  OPTIMUM  LINEAR  FILTER 

The  following  pages  contain  experimental  data  for  Experiment  2.  The  data  is  shown  as  PRBPRB 
plot  of  an  operator  (PD,PFA)-pair  and  an  optimum  linear  filter  ROC. 
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FIGURE  27.  Experiment  2  Signal=4.0,  Diameter=ll. 
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FIGURE  29.  Experiment  2  Signal=4.0,  Diameter=3 . 
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FIGURE  30.  Experiment  2  Signal=4.0,  Diameter=5 . 


9-9s 


84 


FIGURE  31.  Experiment  2,  Signal=4.5,  Diameter=9 . 
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2.  EXPERIMENTAL  DATA.  EXPERIMENT  2:  MATCHED  FILTER 

The  following  pages  contain  experimental  data  for  Experiment  2.  The  data  is  shown  as  PRBPRB 
plots  of  an  operator  (PDiT’FA)-pair  and  a  matched  filter  ROC. 
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FIGURE  32. 


Experiment  2  Matched  Filter  Signal=4.0,  Diameter=21 


FIGURE  33 . 


Experiment  2  Matched  Filter  Signal=4.5,  Diameter=l. 


88 


FIGURE  34.  Experiment  2  Matched  Filter  Signal=4.5,  Diameter=ll 
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Experiment  2  Signal=4.0,  Diameter=5 


FIGURE  38.  Experiment  2 


Filter  Signal=4.5,  Diameter=9 . 


3.  EXPERIMENTAL  DATA.  EXPERIMENT  3 

All  experimental  data  for  the  optimum  linear  filter  used  in  Experiment  3  are  included  in  the 
main  body  of  the  thesis.  The  following  pages  show  PRBPRB  plots  of  an  operator  (PD,PFA)-pair 
and  a  matched  filter  ROC. 
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FIGURE  39.  Experiment  3  Matched  Filter  Signal=0.0,  Diametr=21 
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FIGURE  40.  Experiment  3  Matched  Filter  Signal=1.5,  Diameter=21. 
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APPENDIX  C.  COMPUTER  PROGRAMS 


This  appendix  contains  the  computer  programs  used  in  the  experiments  conducted  for  the 
thesis  and  a  short  discussion  of  the  program  flow  for  each  experiment.  Each  eperiment  was  under 
the  overall  control  of  the  computer.  The  computer  acted  as  the  control,  center.  In  this  command 
role  the  computer  selected  the  background/target  definitions  and  parameters.  The  computer  made 
the  decision  of  whether  a  target  was  to  be  present  in  a  given  display.  Only  the  computer  knew 
this  information.  Neither  the  operator  nor  the  machine/filter  were  told  whether  or  not  a  target 
was  present.  Each  of  the  experiments  collects  both  operator  and  machine  performance  data  in  the 
form  of  (PD,PFA)-pairs-  The  programs  used  for  this  collection  process  specific  to  each  experiment 
are  discussed  in  subsections  of  this  appendix.  The  last  subsection  contains  the  programs  that  are 
common  to  all  experiments.  The  appendix  contains  four  subsections.  These  subsections  are: 

1  .  Appendix  C-RWG  Contains  the  programs  that  support  Experiment  1. 

2  .  Appendix  C-SPOT  Contains  the  programs  that  support  Experiment  2. 

3  .  Appendix  C-SPOTC  Contains  the  programs  that  supportExperiment  3. 

4  .  Appendix  C-Common  Contains  the  programs  that  are  common  to  all  the  experiments. 

Each  experiment  generated  images  for  a  human  to  observe  on  the  computer  screen.  The  human 

made  a  target  present  or  not  present  decision  through  the  use  of  the  keyboard.  The  computer  told 
the  operator  whether  each  decision  he  made  was  right  or  wrong  and  recorded  these  decisions  as 
detections  or  false  alarms.  At  the  end  of  a  sequence  of  trials  the  computer  calculated  probability 
of  detection  and  probability  of  false  alarm  for  the  operator.  For  the  operator  the  experimental 
data  thus  recorded  was  a  single  (PdiPfa)"?^!!"-  The  computer  used  the  same  target  definitions  and 
parameters  to  generate  probabilities  of  detection  and  false  alarm  for  a  machine/filter  equipped  with 
either  an  optimum  linear  filter  or  for  a  matched  filter.  For  the  machine/ filter  the  computer  used 
10,000  trials  to  generate  (PD,EFA)-pairs  at  100  different  thresholds  using  100  different  threshold 
settings.  The  computer  collected  100  (PD,PFA)'Pairs  for  the  machine/filter  in  each  experiment. 

The  Programming  language  used  in  all  of  the  programs  was  MATLAB. 
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APPENDIX  C  RWG 


This  appendix  contains  a  printout  of  the  programs  written  which  support  experiment  1.  This 
experiment  uses  random  white  Gaussian  (RWG)  background  images.  The  control  program  is  OP- 
MACH.  This  program  calls  two  other  programs  called  OPWHITE  and  MACHPERF.  The  OP- 
WHITE  program  collects  the  operator  (PD,RFA)-pair  and  the  MACHPERF  program  collects  the 
machine  (PD,PFA)-pairs. 

The  OPWHITE  program  interfaces  with  the  operator  through  the  keyboard  and  the  computer 
monitor.  The  computer  monitor  displays  eighteen  target/background  images,  and  a  decision  box 
for  the  operator  to  input  his  choice  of  target  present  or  not  present.  OPWHITE  calls  the  programs 
MAKEPILL,  SNRESTER  and  EXOPR3.  The  EXOPR3  program  serves  as  the  interface  between 
the  operator  and  the  computer  monitor  for  the  experimental  data  collection  phase  of  the  exper¬ 
iment.  This  program  collects  the  effective  (PD,PFA)-pair.  EXOPR3  calls  the  programs  CHECK, 
WRITEFILE,  CAMO,  SHOW,  SCALE(1,2,3),  CIRCDAT.  The  program  CIRCDAT  generates  the 
target/background  image.  The  MACHPERF  program  contains  the  algorithm  to  implement  the  ma¬ 
chine/filter.  The  MACHPERF  program  in  effect  offers  the  same  target/background  definitions  and 
parameters  to  the  machine/filter  as  those  shown  to  the  operator.  The  MACHPERF  program  calls 
the  programs  MAKEPILL  and  NOISEGEN.  The  program  NOISEGEN  calculates  the  background 
pixel  values  needed  such  that  a  target  with  a  specified  signature  will  yield  the  nominal  signal-to- 
nois  e-ratio. 


EXPERIMENT  1 


OPMACH 

%  function  called  opmach  designed  to  run  opvliite  and  macl^erf. 

’/,  The  program  obtains  operator  and  machine  probability  of  detection, 
*/,  probability  of  false  alarm  data  (PD,PFA)-pairs  and  graphs  them  for 
comparison. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 


•/. 

y.  INPUTS 
■/.  sig  (1,1) 

y,  snmomCl,!) 
y.  D  (1,1) 

y. 

y.  n  (1,1) 

y,  Nsub  (l,num) 

y. 

y. 

y.  OUTPUTS 

y.  PDo  (1,1) 

y.  PFAQ  (1,1) 

y. 

y.  PDMQS  (100,1) 

y. 

y.  PFAM0S(  100,1) 

y. 
y. 
y. 
y. 


=  Input  pixel  value  of  target 
=  Nominal  signal  to  noise  for  experiment 
=  Diameter  of  circular  disc  to  be  used  in  defining 
the  filter;  D  must  be  odd. 

=  number  of  displays 
^  nundMr  of  pixels  on  the  x  axis. 


=  Probability  the  operator  had  a  true  detection 
=  Probability  the  operator  thought  there  was  a 
target  but  there  was  none 
=  Probability  of  true  detection-report  by  optimum 
filter  at  operator  signal 

=  Probability  of  false  detection-report  by  optimum 
filter  at  operator  signal 


[PDO ,  PFAO ,  PFAMOS ,  PDHOS]  =opmach(n ,  Nsub ,  D ,  sig,  snmom) 


function  [PDO, PFAO, PFAMOS, PDMOS]=opmach(n, Nsub, D, sig, snmom)  ; 

G=randn(2S6,256); 

load  start 

[PDO ,  PFAO ,  snrbar ,  sigsnr ,  snrexp ,  cl ,  c2 , c3 , c4]  =opwhit e (n ,  sig ,  snmom ,D ,  Nsub)  ; 
[PDMOS , PFAMOS]  =machperf  (sig ,  snmom ,D  ,G , PDO  ,PFA0 , Nsub)  ; 
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35  load  start; 

36  H=prbprb(PFA,PD) ; 

37  prprlaer (PDO , PFAO , H , ’ * ’ )  : 

38  prprlaer (PDM0S,PFAM0S,H) 

39  load  fniun; 

40  fig=spriiitf  (’exp#‘/,1.0f  ’  .fnum) 


OPWHITE 

2  '/.  Function  called  opwhite  designed  to  check  an  operator’s  nominal 

3  y,  signal-to-noise  ratio  (snmom)  during  a  target  recognition  sequence. 

4  y.  The  fimction  calculates  an  operators  effective  signal-to-noise-ratio 

5  y,  (snreff)  from  the  error  function  and  the  experimental  (PD,PFA)-pair. 

6  y,  The  program  then  compares  snreff  with  snmom  to  ensure  snreff 

7  y,  is  vithin  2  standard  deviations  of  snmom.  The  program  allows  the 

8  y,  operator  as  many  training  trials  as  he  requests  and  allows  the 

9  y,  operator  to  adjust  the  signal  strength. 


12  y.  IKPUTS 

13  y.  n  (1,1)  =Total  number  of  operator  trials  used  in  the  experiment 

14  y,  sig  (1,1)  =Target  signal  level 

15  y.  D  (1,1)  =Target  radius 

16  y,  Hsub  (1,1)  =Size  of  background  matrix  to  display 

17  y,  snmomd,!)  =Mominal  signal  to  noise  ratio 


20  y.  OUTPUTS 

21  y,  snrexpd.l)  “Signal  to  noise  ratio  that  the  operator  performs  with 

22  y.  during  the  experiment. 

23  y.  sigsnrd,!)  “Standard  deviation  of  the  snmom 

24  y,  snrbard.l)  “average  snr  expected 

25  y,  PDO  (1,1)  “operator  probability  of  detection 

26  y,  PFAO  (1,1)  “operator  probability  of  false  alarm 

27  y,  cl  (2,1)  “  number  of  times  target  was  present  and 

28  y,  detected 

29  y,  c2  (2,1)  “  number  of  times  target  was  present  and  not 

30  y,  detected 

31  y,  c3  (2,1)  =  number  of  times  no  target  and  no  detection 

32  y,  c4  (2,1)  “  number  of  times  no  target  and  false  detection 

33  y. 

34  y. 

35  y.  [PDO , PFAO ,  snrbar ,  s igsnr ,  snrexp ,  c  1 ,  c2 ,  c3 ,  c4!l  “opwhite  (n ,  sig ,  snmom , 

36  D,H8Ub); 


40  function  [PDO, PFAO, snrbar, sigsnr, snrexp, cl, c2,c3,c4]“  ... 

41  opwhite(n,sig,snmom,D,Nsub) ; 

42  noise“noigen(snmom, sig, D, Hsub) ; 

43  [sigsnr, snrbar]“snrester(n, snmom) ; 

44  pill“makepill(Nsub,D) ; 

45  [cl, c2,c3,c4, flag, PDO, PFAO, snrexp]“exopr3(n, Hsub, D, sig,  ... 

46  noise, snrbar, sigsnr, pill) : 


EXOPR3 


1 

2 

3 

4 

5 

6 


%  function  called  ezopr3  used  to  collect  operator  (PD, PFA) -pairs, 
y.  The  program  displays  three  series  of  tzurget  images.  The  first  series 
y,  displays  a  circular  disc  target  in  a  background  pattern.  The  second 
%  series  displays  a  circular  disc  target  in  a  background  pattern  where 
y,  the  background  and  target  are  between  the  mitiiimiBi  pixel  veilue  and  the 
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7  ■/.  mean  value  of  the  pixels.  The  third  series  displays  a  circular  disk 

8  ■/.  target  in  a  background  pattern  where  the  disc  and  the  background 

9  '/,  pattern  are  between  the  mean  background  pixel  value  and  the  maximum 

10  ■/,  background  pixel  value.  The  monitor  display  provides  the  operator 

11  ’/.  with  the  equivalent  of  a  color/contrast  control  knob. 

12  •/. 


13  */ 

INPUTS 

14  •/ 

>  n 

(1,0 

= 

number  of  displays 

15  •/ 

Nsub 

(1,1) 

= 

size  of  the  background  scene  for  display. 

16  •/ 

i  D 

(1.1) 

= 

circle  Diameter 

17  '/ 

i  sig 

(1,1) 

= 

Target  signal 

18  •/ 

noise 

(1.1) 

- 

Target  noise 

19  •/ 

',  snmom 

(1,1) 

= 

nominal  signal  to  noise  voltage  ratio 

20  •/ 

sigsnr 

(1,1) 

= 

standard  deviation  of  the  signal  to  noise 

21  •/ 

t 

ratio 

22  •/ 

(  ss 

(Nsub, Nsub) 

= 

Box  containing  signal  disc  at  center 

23  •/ 

24 

> 

25  •/ 

1 

OUTPUTS 

26  •/ 

cl 

(2,1) 

= 

number  of  times  target  was  present  and 

27  •/ 

1 

detected 

28  •/ 

'  c2 

(2,1) 

= 

niimber  of  times  target  was  present  and  not 

29  • 

/ 

detected 

30  •/ 

c3 

(2,1) 

= 

number  of  times  no  target  eind  no  detection 

31  • 

i  c4 

(2.1) 

= 

number  of  times  no  target  and  false  detection 

32  •/ 

flag 

(1,1) 

= 

emergency  exit  indicator. 

33  ‘ 

(1/0)= (e-exit/norm-end) 

34  •/ 

C  PDQ 

(1,1) 

Probability  the  target  was  present  and  the 

35  5 

operator  identified  it 

36  / 

PFAQ 

(1,1) 

Probability  the  teirget  was  not  present  but 

37  •/ 

( 

the  operator  thought  it  was  present 

38  / 

(  anrexp 

(1,1) 

* 

Signal  to  noise  voltage  ratio  of  the  operator 

39  • 

during  the  experiment 

40  •/. 

41  •/. 

42  ■/,  Ccl,c2,c3,c4,flag,PD0,PFA0,3nrexp]=exopr3(n,Hsub,D,sig,  ... 

43  noise, snmom,sigsnr,ss) 

44 

45  function  [cl,c2,c3,c4,flag,PD0,PFA0,3nrexp]=exopr3(n,Nsub,D,sig,  ... 

46  noise  ,snmom,sigsnr, ss)  ; 

47  R=(D-l)/2; 

48  cl=0;c2=0;c3=0:c4=0; 

49  cla,clg,axis(’off : 

50  f lag=0 ; 

51  count=l; 

52  for  k=l:n 

53  if  flag  =  1  end 

54  T=(rand(l.l)>0.5): 

55  cla,clg; 

56  ki”rand<l,l); 

57  while  ki=l ; 

58  ki^andd,!); 

59  end 

60  ky=rand(l,l); 

61  while  ky=l; 

62  kjnrandCl.l) ; 

63  end 

64  [iiiB,SD,zpl]=circdat(Hstd>,D, noise, sig)  ; 

65  zsl=zpl+(ss*sig*T) ; 

66  subll=scalingl(zsl,mn,SD, .01 ,R) ; 

67  showr(subll,.025, .05,.14,.3.(D-l)/2) ; 

68  subll=scalingl(zsl,iini,SD,l,R) ; 

69  showr (subll , . 19 , . 05 , . 14 , . 3 , (D-1 ) /2) ; 

70  subll=scalingl(zsl,mD,SD,1.5,R) ; 

71  3howr(subll,.355,.05,.14,.3,(D-l)/2): 

72  subll=scalingl(zsl,imi,SD,2,R) ; 

73  showr (subll , . 52 , . 05 , . 14 , . 3 . (D-l)/2) ; 

74  subll=scalingl(zsl,im,SD,2.5,R) ; 
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75  showr (subll ,.685, .05, .14, .3, (D-l)/2) ; 

76  subll=scalingl(zsl  ,inm,SD  ,3,R)  ; 

77  showr (subll , . 85 , . 05 , . 14 , . 3 , (D-1 ) /2) ; 

78 

79  [imnl,SDl,zp2]=circdat(Nsub,D, noise, sig)  ; 

80  zs2=zp2+(ss»sig*T) ; 

81  [3ubl2,scale]=scaling2(zs2,iiiml,SDl,1.4,R) ; 

82  showr (subl2 , . 025 , .35 , . 14, .3 , (D-l)/2) ; 

83  [subl2, scale] =scaling2(zs2,mml,SDl,(3cale+l)  ,R)  ; 

84  showr (subl2 , . 19 , . 35 , . 14, .3, (D-l)/2) ; 

85  [subl2,scale]=scaling2(zs2,mml ,SD1, (scale+2) ,R) ; 

86  showr (subl2 , . 355 , .35 , . 14, .3, (D-l)/2) ; 

87  [3ubl2,scale]=scaling2(zs2,mnil  ,SD1,  (scale+3)  ,R) ; 

88  showr Csubl2 , . 52, . 35 , . 14, . 3, (D-l)/2) ; 

89  [3ubl2,scale]=scaling2(zs2,mml ,SD1, (scale+4) ,R) ; 

90  showr (subl2 , . 685 , .35, . 14 , .3 , (D-1) /2) ; 

91  [3ubl2,scale]=acaling2(zs2,mml,SDl,(scale't-5)  ,R) ; 

92  showr (subl2 , . 85 , . 35 , . 14, .3, (D-l)/2) ; 

93 

94  [imn2,SD2,zp3]=circdat(Nsub,D,noise,sig) ; 

95  z33=zp3+(ss*aig»T) ; 

96  [3Ubl3,scale]=3caliiig3(zs3,inni2,SD2,l,R) ; 

97  showr (3ubl3 , .025 , .65, . 14, .3 , (D-l)/2) ; 

98  [3ubl3, scale] =3caling3(z33, mm2 ,SD2, (3cale+.5) ,R) ; 

99  showr (subl3 , . 19, . 65 , . 14, . 3 , (D-l)/2) ; 

100  [3Ubl3,scale]=3caling3(zs3,mm2,SD2,(3cale+.75) ,R) ; 

101  3howr(subl3, .355, .65, . 14, .3, (D-l)/2) ; 

102  [3ubl3,3cale]=scaling3(z33,mm2,SD2,(3cale+l) ,R)  ; 

103  showr (subl3, .52, .65 ,. 14, .3, (D-l)/2) : 

104  [sublS , scale] =scaling3 (z33 , mm2 ,SD2 , (scale+l . 5) , R) ; 

106  showr  (subl3, .685 , .65, . 14, .3, (D-l)/2) ; 

106  [8ubl3,scala]=scallng3(2a3,mm2,SD2,{acale+2) ,R)  ; 

107  showr (subl3, .85, .65, . 14, .3, (D-i)/2) ; 

108  dispCtarget  number  is’); 

109  diap  (count): 

110  tgt  “  inputCis  there  a  target?  C(y/n) ;  '(y/n)  ... 

111  exits  test  loop]  »’,’s’); 

112  if  (tgt“‘y’l  tgt==’n’) 

113  count=count+l : 

114  if  T; 

115  if  tgt==’y’ 

116  disp( ’CORRECT’); 

117  cl=cl+l; 

118  else 

119  disp( ’WRONG’ ) : 

120  c2=c2+l : 

121  end 

122  else 

123  if  tgt==-’y’ 

124  disp( ’WRONG’) : 

125  c4^4+l ; 

126  else 

127  dispC ’CORRECT’ ) ; 

128  c3”c3+l ; 

129  end 

130  end 

131  if  connt“f loor(n/5)  I  count'“floor(2*n/5)  I  count”  floor(3*n/5)  . . . 

132  I  count”“f loor(4*n/6)  |count==n: 

133  [PD0,PFA0,snrexp,flag]“check(cl,c2,c3,c4,snmom,sigsnr) ; 

134  save  opwdata  cl  c2  c3  c4  PDO  PFAO  snrezp  sigsnr  sig  anmom  D  Nsub; 

135  writefiKcount, cl, c2,c3,c4,3nrexp, PDO, PFAO, sigsnr, sig, snmom,D, Nsub)  ; 

136  else 

137  PD0=cl/(cl+c2) : 

138  PFA0=c4/(c3+c4): 

139  if  PD0<1  b  PD0>0  b  PFA0<1  ftPFA0>0 

140  t2sig=erf inv(l-2*PFA0) ; 

141  snrexp=sqrt(2)*(t2sig-erfimr(l-2*PD0)) ; 

142  sprintf  (’PD0:y,5.4f  PFA0:*/,5.4f  snreip:y.5.4f  ’  ,PD0,PFA0,snrexp) 
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end 


143 

144  end 

145  if  flag==l  break;  end 

146  else 

147  flag=l: 

148  break; 

149  end 

150  end 

151  PDQ=(cl)/(cl+c2)  ; 

152  PFA0=(c4)/(c3+c4)  ; 

153  t2sig=erfinv(l-2*PFA0) ; 

154  snrerp=sqrt(2)*(t2sig-erf inv(l-2*PD0)) ; 
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%  function  called  circdat  used  to  generate  a  pixel  image  of  a  circle 
'/,  in  a  square  background.  The  background  pixel  values  have  a  gaussiam 
’/,  random  distribution 


INPUTS 

(1.1) 


signal 


=  number  of  pixels  on  the  side  of  the 
square 

=  circle  diameter 
=  rms  noise  level 

=  fixed  level  (above  or  belou  one-half) 
for  circle  signal 


*/.  mm  (1,1)  =  mean  pixel  value  of  target  circle 

*/,  SD  (1,1)  =  pixel  standard  deviation  in  sub  uith  target 

*/,  pic  (Hsub.Hsub)  =  Random  background  matrix 

•/. 

•/, 

*/,  [am,  SD,  pic]  =circdat(Hsub,D, noise,  signed.) 


function  Cmm,SD,pic]=circdat(Hsub,D, noise, signal) ; 
R=(D-l)/2; 

pic=noise*randn(H3ub ,N3ub)+0 . 5 : 
x=((l:Nsub)-Nsiib/2) . '2;  x=x’*onas(size(x))  ;  y=x’; 
xy=x+x’ ; 

ii=f ind(xy>R‘ 2)  ; 
jj=find(xy<=R'2) ; 
jjj=find(xy=-R‘2)  ; 

Sig=signal*onaa(Hsub,Hsub) ; 
Sig(ii)=zoros(siza(Sig(ii))) ; 
pic=pic+Sig; 

Tu=0 . 5+3ign2j.+2 . 0*noi3a ; 

71=0 . 5-2 .0*noisa ; 

Cout=sum(sum(ones(size(ii)))) ; 

C=Hsub ‘ 2-Cout ; 
kk=find(pic>Tu) ; 
picu=zeros(aiza(pic)) ; 
picu(kk)=pic(kk) -Tu; 
pic(kk)=Tu*ones(size(pic(kk) )) ; 
ll=f  ind(pic<Tl) ; 
picl=zeros(3ize(pic)) ; 
picl(ll)=pic(ll)-Tl; 
pic(ll)=Tl*ones(size(pic(ll))) ; 
picul=picu+picl ; 

adjout=s\m(su]n(picul(ii)  )  )/Cout ; 

pic(ii)=pic(ii)+adjout ; 

ad  j  in=suiii(sum(picul  (  j  j  )  )  )  /C ; 

pic(jj)=pic(jj)+adjin: 

pied ,  1)  =Tu+0 . 25*noiae : 
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53  picCl ,2)=Tl-0 . 25+noise ; 

54  nim=mean(pic(jj)) ; 

55  SD=std(pic(jj ( :) ) ) ; 


MACHPERF 
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*/,  Function  called  machperf  designed  to  analyze  performance  in  terms 
*/,  of  PD/PFA  of  a  machine  in  looking  for  a  uniform  circular  disc  target . 
y.  The  target  is  present  in  a  background  scene  that  is  randomly  chosen, 
y.  The  machine  uses  a  set  of  filter  weights  (from  a  matched  filter) 


y,  and  a  threshold  to  detect  targets. 

y. 

y. 


y,  INPUTS 

y,  sig  (1,1) 

y,  snmomd.l) 

y.  D  (1.1) 

y. 

y.  0  (256,256) 

y.  PDQ  (1,1) 

y.  PFAQ  (1,1) 
y,  Nsub  ( 1 ,  N) 

y. 

y.  OUTPUTS 
y.  PDMQS  (100,1) 

y. 

y,  PFAMOS (100,1) 

y. 

y. 


=  Input  pixel  value  of  target 
=  nominal  signal  to  noise  ratio 

=  Diameter  of  circular  disc  to  be  used  in  defining 
the  filter;  D  must  be  odd. 

=  Random  background 
=  Operator  probability  of  detection 
=  Operator  probability  of  false  alarm 
=  Size  of  background  scene  to  display 


=  Probability  of  true  detection-report  by  optimum 
filter  at  operator  signal 

=  Probability  of  false  detection-report  by  optimum 
filter  at  operator  signal 


y. 


y. 

y,  CPDM0S,PFAM0S]=machparf  ( sig, snmom,D,G,PD0,PFA0, Nsub)  ; 


function  CPDM0S,PFAM0S]=machperf  (sig,snmom,D,G,PD,PFA,Hsub)  ; 
siguFsig; 

noise=noigen(snmom, sig, D, Nsub)  ; 
pill=makepill(Nsub,D) ; 

R=(D-l)/2: 

RK=(Hsub-l)/2; 
x=(-RK:RH).‘2: 
r=onos (s ize (i ’ ) ) : 

R2=i+x’: 

ii=find(R2<=R'2) ; 

L=length(ii) ; 
pd=256-Hsub ; 
qd=256-Hsub ; 

Suml=  □  : 

N=10000; 

x=n: 

Y=a: 

A=sum(pill(ii) ) ; 
for  b=>l:H 

I”  (RH+l)+pd*rand(l,l) : 
y-  (RH+1 ) +qd*rand( 1,1); 

Z-  G(i-RH:i+RH,y-RN:y+RN) : 

SumlxCSuml;  sum(sum(Z.*pill))l ; 
end 

Sums'' [Suml*noise  Suml*noise-t-sigm*L] ; 

T=linspace(min(min(Sums)) ,maz(max(Sums)) ,102) ; 

T(102)  =  a  ; 

T(1)=D; 

PDM0S=  □  ; 

PFAM0S=n  ; 
for  b=l:100 

e“(T(b)  <  Sums) ; 
e=sum(e) ; 
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62  PDMOS=CPDMOS  e(2)/N] ; 

63  PFAMOS= CPF AMOS  e(l)/H]; 

64  end 


APPENDIX  C  SPOT 


This  appendix  contains  a  printout  of  the  programs  written  which  support  experiment  2.  This 
experiment  uses  SPOT  background  images.  The  control  program  is  OPMACH.  This  program  calls 
programs  called  OPNWHITE  and  MACHPERF.  The  OPNWHITE  program  collects  the  operator 
(PD,-PFA)-pair  and  the  MACHPERF  program  collects  the  machine  (PD,PFA)-pairs. 

The  OPNWHITE  program  provides  the  operator  with  a  training  phase  then  when  the  operator 
feels  comfortable  with  target  recognition  the  program  begins  the  experimental  phase.  The  OPN¬ 
WHITE  program  interfaces  with  the  operator  through  the  keyboard  and  the  computer  monitor.  The 
computer  monitor  displays  eighteen  target/background  images,  and  a  decision  box  for  the  operator 
to  input  his  choice  of  target  present  or  not  present.  OPNWHITE  calls  the  programs  MAKEPILL, 
PDSNREST  and  EXOPR3.  PDSNREST  estimates  the  effective  (PD,PFA)-pair  of  an  xperiment. 
PDSNREST  allows  the  operator  to  have  as  many  training  trials  as  he  requests.  The  program  also 
allows  the  operator  to  adjust  the  target  signature  strength  so  that  the  effective  (PDiPFA)-pair  is 
close  to  the  nominal  (PD,PFA)-pair.  The  PDSNREST  calls  the  program  EXOPR3  which  serves  as 
the  interface  between  the  monitor  and  the  operator  and  collects/calculates  the  operator  effective 
(Po,Pp^)-pair.  The  EXOPR4  program  serves  as  the  interface  between  the  operator  and  the  com¬ 
puter  monitor  for  the  experimental  data  collection  phase  of  the  experiment.  This  program  collects 
the  effective  (PD,PFA)-pair  collected  as  data.  EXOPR4  calls  the  programs  CHECK,  WRITEFILE, 
CAMO,  SHOW,  SCALE(1,2,3),  MTAR.  MTAR  adds  a  target  of  uniform  signature  to  the  back¬ 
ground  pixels.  The  MACHPERF  program  contains  the  algorithm  to  implement  the  machine/ filter. 
The  MACHPERF  program  in  effect  offers  the  same  target/background  definitions  and  parameters 
to  the  machine/ filter  as  those  shown  to  the  operator.  The  MACHPERF  program  calls  the  programs 
PSDGEN,  MAKEPILL,  CAM.  MAKEPILL  and  CAM  serve  the  same  purpose  as  in  the  operator 
collection  phase.  The  program  PSDGEN  calculates  the  background  matrix  spatial  frequency  power 
spectral  density  (PSD)  which  is  then  used  to  implement  the  optimum  linear  filter. 


EXPERIMENT  2 
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'/,  function  called  opmach  designed  to  run  opwhite  and  nacbperf. 

*/,  The  program  obtains  operator  and  machine  probability  of  detection, 
'/,  probability  of  false  alarm  and  graphs  them  for  conqjarison. 

•/. 


•/. 

7.  INPUTS 
7,  sig  (1,1) 

7.  D  (1,1) 

7. 

7.  n  (1,1) 

7,  Hsub  (l,num) 

7. 

7. 


Input  pixel  value  of  target 

Diameter  of  circular  disc  to  be  used  in  defining  the 

filter;  D  must  be  odd. 

number  of  displays 

number  of  pixels  on  the  x  axis. 


7.  OUTPUTS 

7,  PDO  (1,1)  =  Probability  the  operator  had  a  true  detection 

7.  PFAO  (1,1)  =  Probability  the  operator  thought  there  was  a 

7,  target  but  there  was  none 

7,  PDMOS  (100,1)=  Probability  of  true  detection-report  by  optimum 
7.  filter  at  operator  signal 

7,  PFAMOSdOO,!)  =  Probability  of  false  detection-report  by  optimum 
7,  filter  at  operator  signal 

7. 


7. 

7.  [PDO ,  PFAO ,  PFAMOS ,  PDMOS]  =opmach(n,Haub,D ,  sig) 


27 

28  function  [PDO ,PFA0 .PFAMQS ,PDMOS]=opmach(n,Hsub,D ,sig) ; 

29  load  start 

30  [PDO , PFAQ , snrbar , sigsnr , snrexp , cl , c2 , c3 , c4] =opnwhite (n , sig , z , D , Nsub) ; 

31  CPDHOS  ,  PFAMOS]  =macliperf  ( s ig , D ,  z . PDO ,  PFAO ,  Hsub ,  ssow)  ; 

32  H=prbprb(PFA,PD) : 

33  prbprbCPFAO.PDO.H.’ro'); 

34  prbprbCPFAMOS.PDMOS.H, >g-') ; 

35  load  fnujn; 

36  f  ig=3printf  (’exp#'/,l  .Of  ’ 
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'/,  Function  called  opnuhite  designed  to  check  an  operator’s  effective 
y,  signal -to-noise  ratio  (snreff)  during  a  target  recognition  sequence. 

■/,  The  program  calculates  an  operator’s  (snr)  from  the  error  function 
y.  and  the  operator  (PD,PFA)-pair.  The  program  then  compares  this  value 
y.  with  the  nominal  snr  (snmom)  to  see  if  the  operator  snreff  is  vithin 
y,  two  standard  deviations  of  snmom.  The  program  eillows  the  operator  as 
y,  many  trials  for  trainup  as  he  requests.  The  program  gives  the 
y,  operator  the  capability  to  adjust  the  signal  of  the  experiment. 

y. 


y. 

y.  INPUTS 
y.  n  (1.1) 
y.  sig  (1,1) 
y.  D  (1,1) 
y,  Hsubd  ,1) 
y.  z(256,256) 

y. 

y. 

y.  OUTPUTS 
y,  snrezpd.l) 

y. 

y,  sigsnrd,!) 
y.  snrbard,!) 
y.  PDO  (1,1) 
y.  PFAO  (1,1) 
y.  cl  (2,1) 

y. 

y.  c2  (2,1) 

y. 

y.  c3  (2,1) 

y.  c4  (2,1) 

y. 


=Total  number  of  operator  trials  used  in  the  experiment 
=Target  signal  level 
=Target  radius 

=Size  of  background  matrix  to  display 
=backgroimd  to  display 


=Signal  to  noise  ratio  that  the  operator  performs  with 
during  the  experiment . 

“Standard  deviation  of  the  snmom 
“average  snr  expected 
“operator  probability  of  detection 
“operator  probability  of  false  alarm 
“number  of  times  target  was  present  and 
detected 

mumber  of  times  target  was  present  and  not 
detected 

mumber  of  times  no  target  and  no  detection 
^number  of  times  no  target  and  false  detection 


y. 


y,  [PD0,PFAQ,snrbar,sigsnr .snrexp, cl, c2,c3,c4] “opnwhite(n, sig, z,D, Nsub) ; 


function  [PDO, PFAO, snrbar, sigsnr, snrexp. cl, c2,c3,c4]“  ... 

opnwhite(n, sig, z,D, Hsub) ; 

pill“makepill(Hsub,D) ; 

[sigsnr, snrbar, sig] “pdsnrest(n, Nsub, D, sig, z, pill) ; 

[cl, c2,c3,c4, flag, PDO, PFAO, snrexp]“  . . . 

ezopr4(n,Nsub,D,sig,z,snrbar,sigsnr ,pill)  ; 


MACHPERF 

2  y.  Function  called  machperf  designed  to  analyze  performance  in  terms 

3  y.  of  PD/PFA  of  a  machine  in  looking  for  a  uniform  circular  disc  target 

4  y.  with  ijq>erfect,  camouflage.  The  target  is  present  in  a  background 

5  y,  scene  that  is  randomly  chosen. The  machine  uses  a  set  of  filter 

6  y.  weights  to  recognize  targets. 

7  y. 
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8  •/.  INPUTS 

9  ■/.  sigm  (1,1)  =  Input  pixel  value  of  target 

10  '/,  D  (1,1)  =  Diameter  of  circular  disc  to  be  used  in  defining 

11  •/,  the  filter;  D  must  be  odd. 

12  ■/.  z  (256,256)  =  Background  scene 

13  ’/.  PDO  (1,1)  =  Operator  probability  of  detection 

14  */,  PFAO  (1,1)  =  Operator  probability  of  false  alarm 

15  */,  Nsub  (1,H)  =  Size  of  background  scene  to  display 

16  ■/.  filt  (Nsub,Hsub)=  filter  ueight  array 

17  •/. 

18  */.  OUTPUTS 

19  '/.  PDMOS  (100,1)  =  Probability  of  true  detection-report  by  optimum 

20  y.  filter  at  operator  signal 

21  y.  PFAMOSdOO,  1)  =  Probability  of  false  detection-report  by  optimum 

22  y,  filter  at  operator  signal 

23  y. 

24  y. 

25  y.  [PDM0S,PFAM0S]=machperf (3igm,D,z,PD0,PFA0,Nsub,filt)  ; 

26 

27  fxmction  [PDMOS, PFAMOS]=machperf (sigm, D,z, PDO, PFAO. Nsub, filt) ; 

28  R=(D-l)/2; 

29  RN=(Nsub-l)/2: 

30  x=(-RH;RH).‘2; 

31  x=onea(size(x’))*x; 

32  R2=i+x’; 

33  ii=find(R2<=R'2) ; 

34  L=length(ii) ; 

35  if  exist (  ’ss’): 

36  pill=makepill(Hsub,D) : 

37  filt=pill; 

38  else  exist ( ’ssow’ ) : 

39  pill=makepill(256,D) ; 

40  s=fft2(pill) ; 

41  PSD*psdgen(50,z) : 

42  330w=real(ifft2(3,/PSD)) ; 

43  P=(129-(Hsub-l)/2) : (129+(H3Ub-l)/2) ; 

44  3sow=ssoh(P,P) : 

45  filt=ssoH; 

46  end 

47  pd=256-Naub; 

48  qd=256-Nsub; 

49  Suml=  □  ; 

50  N=10000; 

51  x=a: 

52  ?=□: 

53  A=sum(filt<ii)) : 

54  for  b=l:N 

55  X-  (RN+l)+pd*rand(l,l) ; 

56  y“  (RH+l)+qd*rand(l,l) : 

57  Z=  z(x-RH:x+RH,y-RN;y+RH) : 

58  SuBl~[Suml;  sumCsumCZ.ef ilt))] ; 

59  end 

60  Sums> [Suffll  Suml+sigmeA] ; 

61  T=lin3pace(min(min(Sums)) ,max(max(Sums)) ,102) ; 

62  T(102)«n: 

63  TCD-D; 

64  PDMOS-  □  ; 

65  PFAMOS-D: 

66  for  b-1: 100 

67  e-(T(b)  <  Sums) ; 

68  e-8um(e) ; 

69  PDMOS- [PDMOS  e(2)/H3: 

70  PFAM0S=[PFAM0S  e<l)/H]; 

71  end 


PSDGEN 
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22 

23 
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'/,  Function  called  psdgen  used  to  develop  a  two  dimensional  power 
'/.  spectral  density  (psd)  from  a  two  dimensional  background  scene.  Based 
y,  on  the  assumption  of  isotropy  a  one  dimensional  result,  psd  versus 
y,  spatial  frequency  magnitude,  is  developed.  A  single  scene  is  used  and 
y.  ensemble  averaging  is  "accomplished"  by  averaging  over  a  ring  in 
y,  spatial  frequency  space.  The  program  uses  spline  interpolation  on  the 
y,  calculated  set  of  psd  values  to  generate  a  two  dimensional  array  of 
y,  psd  values  corresponding  to  the  frequencies  of  the  two  dimensionnal 
y,  FFT  of  the  input  background  scene. 

y. 


y. 

y.  INPUTS 

y,  N  (1,1)  =  Number  of  spatial  frequencies 

y,  z  (256,256)  =  Background  scene 

y. 

y. 

y.  OUTPUTS 

y.  PSD  (256,256)  =  2-D  version  of  psd 

y. 

y,  PSD=psdgen(N,z) 


function  PSD=p3dgen(N,z) ; 
zz=fft2(z) i 

k=0:127;  k=Dc  -fliplr(k+l)]  ; 

k=ono3(256, l)*k: 

k=k,‘2;  k=k+k’ ;  k=sqrt(k); 

f=128*sqrt(2)*(l:N)/N; 

df=(f(2)-f(l))/2: 

psd=  □  ; 

for  n=l:H 

ii=  f ind(k>f (n)-df  ft  kk^f (n) +df ) ; 

psd  *  Cpsd  sum((ab3(zz(ii))) . ‘ 2)/langth(ii)] ; 

end 

p3d(35) = (p3d(34) +psd(36) ) /2 ; 
k=k(:) ; 

PSD=spline(f ,psd,k) ; 

PSD=reshapa(PSD,256.256) ; 


EXOPR3 

1  uwxixixixixixixixixixixixixtxixixixixixm^^^^ 

2  y,  function  called  exopr3  used  to  collect  operator  (PD, PFA) -pairs. 

3  y.  The  program  displays  three  series  of  t2a:get  images.  The  first  series 

4  y,  displays  a  circular  disc  target  in  a  background  pattern.  The  second 

5  y,  series  displays  a  circular  disc  target  in  a  background  pattern  where 

6  y,  the  background  and  target  are  between  the  minimum  pixel  ved.ue  and  the 

7  y.  mean  value  of  the  pixels.  The  third  series  displays  a  circuleir  disk 

8  y,  target  in  a  background  pattern  where  the  disc  and  the  backgroimd 

9  '/■  pattern  are  between  the  mean  background  pixel  value  and  the  maTimnm 

10  y.  background  pixel  value.  The  monitor  display  is  designed  to  provide 

11  y.  the  operator  with  the  equivalent  of  a  color/contrast  control  knob. 

12  %  The  function  collects  operator  performance  numbers  from  which  pd  and 

13  %  pfa  are  calculated.  The  data  collection  is  based  on  some  specified 

14  %  number  of  separate  displays.  This  program  is  designed  for  the 

15  'L  pre-experiment  stage  when  the  operator  is  being  trained  and  PD, PFA 

16  y.  are  being  verified. 

17  y. 


number  of  displays 

size  of  the  background  scene  for  display. 

circle  Diameter 

Target  signal 

Random  image  field 

Box  containing  signal  disc  at  center 


18  y. 

INPUTS 

19  y. 

n 

(1,1) 

20  y. 

Hsub 

(1.1) 

21  y. 

D 

(1,1) 

22  y. 

sig 

(1,1) 

23  y. 

z 

(256,256) 

24  y. 

S8 

(Hsub, Hsub) 

25  y. 
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26 

27 

•/. 

•/. 

OUTPUTS 

28 

29 

7.  cl 

7. 

C2,l) 

=  number  of  times  target  was  present  and 
detected 

30 

31 

7.  c2 

7. 

C2,l) 

=  number  of  times  target  was  present  and  not 
detected 

32 

7.  C3 

(2,1) 

=  number  of  times  no  target  and  no  detection 

33 

7.  C4 

(2,1) 

=  number  of  times  no  target  and  false  detection 

34 

35 

7.  flag 

7. 

(1,1) 

=  emergency  exit  indicator, 

( 1/0  ) = (e-exit/norm-end) 

36 

37 

7.  PD 

7. 

(1,1) 

-  Probability  the  target  was  present  and  the 
operator  identified  it 

38 

39 

40 

41 

42 

7.  PFA 

7. 

7. 

7. 

(1,1) 

=  Probability  the  target  was  not  present  but 
the  operator  thought  it  was  present 

*/.  [c  1 ,  c2 ,  c3 ,  c4 ,  f  lag ,  PD ,  PFA]  =exopr3  (n ,  Nsub  ,D ,  3ig ,  z ,  ss) 

43 

44 

45 

46  function  [cl,c2,c3,c4,flag,PD,PFA]=exopr3(n,Hsub,D,sig,z,33) ; 

47  if  n>25  n=25:  end; 

48  R=(D-l)/2: 

49  cl=0;c2=0;c3=0:c4=0; 

50  cla,clg,aii3(’off ’) : 

51  flag=0: 

52  count=l; 

53  for  k=l:n 

54  if  flag  =  1  end 

55  T=(rand(l,l)>0.5) : 

56  cla,clg; 

57  kx”rand(l,l) ; 

58  while  kx^l; 

59  lac=rand(l,l) ; 

60  end 

61  ky*rand(l,l); 

62  while  ky=l ; 

63  ky“rand(l,l) ; 

64  end 

65  Diim.SD,zpl]=iBtar(H3ub,D,z,ki,ky) ; 

66  zsl“zpl+(s3*8ig*T) ; 

67  3ubll=scalingl(zsl,iiin,SD,  .01  ,R)  ; 

68  showrCsubll, .025 , .05, . 14, .3,  (D-l)/2) ; 

69  subll=scalingl(zsl,iini,SD,l,R) ; 

70  showrCsubll , . 19, .05 , . 14, .3, (D-l)/2) ; 

71  subll=scalingl(zsl,iini,SD,1.5,R) ; 

72  showrCsubll, .355, .05, . 14, .3, CD-I) /2) ; 

73  subll=scalinglCz3l,iini,SD,2,R) : 

74  showrCsubll , .52, .05, . 14, .3, CD-I) /2) ; 

75  subll=scalinglCzsl,nm,SD,2.5,R) ; 

76  showrCsubll , . 685, .05, . 14, .3 , CD-l)/2) ; 

77  subll=scalinglCzsl,iiiii,SD,3,R) : 

78  showrCsubll, .85, .05, . 14, .3,  CD-l)/2) ; 

79 

80  [imil,SDl,zp2]=iiitarCHsub,D,z,kz,k7) ; 

81  zs2=zp2+Css*sig*T) ; 

82  [subl2,scale]-scsling2Czs2,nml,SDl,1.4,R) ; 

83  showrCsubl2 , .025 , .35, . 14, .3, CD-I) /2) ; 

84  [subl2, scale) ^scaling2 Czs2, mal, SDl, Cscaletl) ,R)  ; 

85  showr  Csubl2 , . 19 , . 35 , . 14 , . 3 , CD-I ) /2) ; 

86  [subl2, scale) °scaliiig2 Czs2, mml, SDl,  Cscale42)  ,R)  ; 

87  showr Csubl2, .355, .35, . 14, .3, CD-I) /2) ; 

88  Csubl2,scale)=scaling2Czs2,iiiiiil,SDl,Cscalo+3)  ,R) ; 

89  showr Csubl2, .52, .35, . 14, .3,CD-l)/2) ; 

90  [subl2,scale)-scaling2Czs2,mDil,SDi,Cscale-)-4)  ,R) ; 

91  showr Csubl2, .685, .35, . 14, .3, CD-I) /2) ; 

92  [subl2, scale)  =scaling2 Czs2, mml , SDl,  Cscale-t-5)  ,R)  ; 
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93  sho«T(subl2. .85, .35,.14, .3,(D-l)/2) ; 

94 

95  [iimi2,SD2,zp3]=mtar(Nsub,D,z,kx,ky) : 

96  zs3=zp3+(ss*sig*T) ; 

97  [3Ubl3,scale]=scaliiig3(zs3,mm2,SD2,  .5,R) ; 

98  showr(subl3, .025, .65. . 14, .3,(D-l)/2) ; 

99  [siibl3,scale]=scaling3(zs3,iimi2,SD2,  (scale+1)  ,R) ; 

100  shour(subl3 , . 19 , . 65 , . 14, .3, (D-l)/2) ; 

101  [subl3,scale]=scaling3(z33,mm2,SD2, (scale+1) ,R) ; 

102  showr(siibl3,.355,  .65,  .14,  .3,(D-l)/2)  ; 

103  [subl3,scale]=scaling3(zs3,mm2,SD2, (scale+1) ,R) ; 

104  showr(subl3, .52, .65,. 14, .3,(D-l)/2) ; 

105  [3ubl3 .scale] =scaling3(zs3, mm2, SD2, (scale+1) ,R) ; 

106  shour (subl3 , . 685 , . 65 , . 14 , . 3 , (D-1) /2) ; 

107  [3ubl3,scala]=scaling3(zs3, mm2, SD2, (scale+1) ,R) ; 

108  showr (subl3 , . 85 , . 65 , . 14 , . 3 , (D-l)/2) ; 

109 

110 

111  dispCtarget  number  is’); 

112  disp  (count); 

113  tgt  =  inputCis  there  a  target?  [(y/n);  ”(y/n)  exits  test  loop]  >>’,’s’ 

114  if  (tgt==’y’l  tgt— ’n’) 

115  count=count+l ; 

116  if  T; 

117  if  tgt==’y’ 

118  disp( ’CORRECT’) : 

119  cl=cl+l; 

120  else 

121  disp( ’WRONG’ ) ; 

122  c2=c2+l; 

123  end 

124  else 

125  if  tgt— ’y’ 

126  disp( ’WRONG’) ; 

127  c4=c4+l ; 

128  else 

129  disp( ’CORRECT’) ; 

130  c3=c3+l ; 

131  end 

132  end 

133  else 

134  flag=l; 

135  break; 

136  end 

137  end 

138  PD=(cl)/(cl+c2) ; 

139  PFA=(c4)/(c3+c4) ; 


EXOPR4 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 
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12 

13 

14 

15 
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17 


*/,  ftmction  called  exopr4  used  to  collect  pd/pfa  related  data.  This 
*/.  function  will  display  three  series  of  target  Images.  The  first  series 
*/,  displays  a  circular  disc  target  in  a  background  pattern.  The  second 
'/,  series  displays  a  circular  disc  target  in  a  background  pattern  where 
*/,  the  background  and  target  are  between  the  minimum  pixel  value  and  the 
'/,  mean  value  of  the  pixels.  The  third  series  displays  a  circular  disk 
*/,  tctrget  in  a  background  pattern  where  the  disc  and  the  background 
'/,  pattern  are  between  the  mean  background  pixel  value  and  the  mailmmn 
'/.  background  pixel  value.  The  monitor  display  is  designed  to  provide 
*/,  the  operator  with  the  equivalent  of  a  color /contrast  control  knob. 

'/,  The  function  collects  operator  performance  numbers  from  which  pd  and 
'/.  pfa  are  calculated.  The  data  collection  is  based  on  some  specified 
'/.  number  of  separata  displays.  This  program  is  designed  for  the 
'/,  experiment  stage  when  the  operator  (PD ,  PFA) -pair  is  collected. 

•/. 


•/.  INPUTS 


-  no- 


16 

y.  n 

Cl,l) 

number  of  diaplays 

19 

y.  IJsub 

Cl,l) 

= 

aize  of  the  background  acene  for  diaplay. 

20 

%  D 

ci.l) 

= 

circle  Diameter 

21 

y.  sig 

Cl.l) 

= 

Target  aignal 

22 

y.  z 

C256,256) 

= 

Background  acene  to  diaplay 

23 

y,  snmom 

Cl.l) 

- 

nominal  aignal  to  noiae  voltage  ratio 

24 

y,  aiganr 

Cl.l) 

standard  deviation  of  the  aignal  to  noiae 

25 

y. 

ratio 

26 

y.  33 

CHaub.Haub) 

Type  of  filter 

27 

y. 

28 

y. 

29 

y, 

OUTPUTS 

30 

y.  cl 

C2.1) 

= 

number  of  timea  target  waa  preaent  and 

31 

y. 

detected 

32 

y.  c2 

C2.1) 

= 

number  of  timea  target  waa  preaent  and  not 

33 

y. 

detected 

34 

y.  c3 

C2.1) 

= 

number  of  timea  no  target  and  no  detection 

35 

y.  c4 

C2.1) 

= 

number  of  timea  no  target  and  falae  detection 

36 

y.  flag 

Cl.l) 

= 

emergency  exit  indicator. 

37 

y. 

C 1/0 ) = Ce-exit/norm-end) 

38 

y,  PDo 

Cl.l) 

= 

Probability  the  target  waa  present  and  the 

39 

y. 

operator  identified  it 

40 

y.  PFAO 

Cl.l) 

= 

Probability  the  target  was  not  present  but 

41 

y. 

the  operator  thought  it  was  present 

42 

y,  anrerp 

Cl.l) 

= 

Signal  to  noise  voltage  ratio  of  the 

43 

y. 

operator  during  the  experiment 

44  •/, 

45  y. 

46  y,  [cl,c2,c3,c4,flag,PD0,PFA0,siirexp]=exopr4(n,H3ub,D,sig,  ... 

47  z,snmom,sigsnr,ss) 

48 

49  function  Ccl,c2,c3,c4,flag,PDQ,PFA0,snrexp]=exopr4(n,H3ub,D,sig,  ... 

50  2,3nmom,aigsnr,33) : 

51  R=(D-l)/2; 

52  cl=0;c2=0;c3=0:c4=0! 

53  cla,clg,aiis(’off : 

54  flag=0: 

55  count=l; 

56  for  k=l:n 

57  if  flag  =  1  end 

58  T=(rand(l,l)>0.5) ; 

59  cla.clg; 

60  kx=rand(l,l); 

61  while  ki=l: 

62  kx*rand(l,l) ; 

63  end 

64  ky=rand(l,l) : 

65  while  ky**l ; 

66  ky*randCl,l) : 

67  end 

68  Ciim,SD,zpl]=iiitar(Hsub,D,z,kx,k7) ; 

69  zsl=zpl+(8a*aig*T) ; 

70  3ubll=^acalinglCzsl,nm,SD,  .01  ,R)  ; 

71  ahowrCaubll , .026, .05, . 14, .3,(D-l)/2) ; 

72  subll=acalingl(zal,iim,SD,l,R) ; 

73  ahowrCaubll , . 19, .05, . 14, .3, (D-l)/2) ; 

74  subll=3calingl(z3l,nBi,SD,1.5,R) ; 

75  ahowrCsubll , .355, .05, . 14, .3, (D-l)/2) ; 

76  subll=8calingl(z3l,im,SD,2,R) ; 

77  ahowrCaubll,. 52,. 05,. 14,. 3, (D-l)/2); 

78  subll=3C8LlinglCz3l,iim,SD  ,2.5,R) ; 

79  ahowrCaubll , .685, .05, . 14, .3,CD-l)/2) ; 

80  3ubll=3calinglCzsl,iiis,SD,3,R) ; 

81  ahowrCaubll,. 85, .05 , . 14, .3, CD-l)/2) ; 

82 

83  [niBl,SDl,zp2]=ntarCHaub,D,z,ki,ky); 

84  zs2=zp2+Ca3*aig*T) ; 

85  [3ubl2,3cale!l-8caling2Cz32,miil,SDl,1.4,R) ; 
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showr(subl2 , . 025 , . 35 , . 14 . .3 , (D-1) /2) ; 

[subl2, scale]  =scaling2 (zs2, mml  ,SD1,  (scale-t-1)  ,R)  ; 
showr (subl2 , . 19 , . 35 , . 14 , . 3 , (D-1) /2) ; 

[subl2, scale] =scaling2(zs2, mml ,SD1 , (scale+2) ,R) ; 
showr (subl2, .355, .35, . 14, .3,(D-l)/2)  ; 

[subl2, scale] =scaling2(zs2, mml ,SD1, (scale+3) ,R) ; 
showr(subl2 , . 52 , . 35 , . 14, .3, (D-l)/2) ; 
[subl2,scale]=3calirig2{zs2,imnl,SDl,  (scale+4)  ,R) ; 
showr (subl2 , . 685 , . 35 , . 14 , . 3 . (D-1) /2) ; 

[subl2, scale] =scaling2(zs2, mml ,SD1, (scale+5) ,R) j 
showr (subl2 , . 85 , . 35 , . 14 , . 3 , (D-1 ) /2) ; 

[nmi2,SD2,zp3]=mtar(H3ub,D,z,lac,ky) ; 
zs3=zp3+(ss*sig*T) ; 

CsublS ,  scale]  =3caliiig3  (zsS  ,mm2 ,  SD2 , 1 ,  R)  ; 
showr (subl3, .025 , .65, . 14, .3, (D-l)/2) ; 
[subl3,scale]=scaliiig3(zs3,mm2,SD2,  (scale+.5)  ,R) ; 
showr(3ubl3,.19, .65,.14,.3,(D-l)/2) ; 

[subl3, scale]  =scaling3(zs3, mm2, SD2, (scale+.75) ,R)  ; 
showr (subl3 , . 355 , . 65 , . 14 , . 3 , (D-1) /2) ; 

[3ubl3, scale] =scaling3(z33, mm2, SD2, (scale+1) ,R)  ; 
showr (3ubl3 , . 52, . 65 , . 14, . 3, (D-l)/2) ; 

[3ubl3, scale]  =3caliiig3(zs3, mm2, SD2,  (scale+1. 5)  ,R) ; 
showr (subl3 , . 685 , . 65 , . 14 , .3 , (D-1) /2) ; 

[subl3, scale] =scaling3(z33, mm2, SD2, (scale+2) ,R)  ; 
showr (3ubl3 , . 85 , . 65 , . 14 , . 3 , (D-1) /2) ; 


di3p(’target  number  is’); 
disp  (count) ; 

tgt  =  input (’is  there  a  target?  [(y/n) ;  ... 

'(y/n)  exits  test  loop]  >>’,’3’); 
if  (tgt==’y’l  tgt==’n’) 
count=count+l ; 
if  T; 

if  tgt==’y’ 

disp (’CORRECT’): 
cl=cl+l ; 
else 

disp( ’WRONG’ ) ; 
c2=c2+l : 

end 

else 

if  tgt==’y’ 

disp( ’WRONG’ ) : 
c4=c4+l ; 
else 

disp (’CORRECT’) ; 
c3=c3+l ; 

end 

end 

if  count=floor(n/5)  I  count=floor(2*n/5)  I  count=  . . . 
floor(3*n/5)  1  count==floor(4*n/5)  |count==n: 

[PDO  ,PFA0 ,  snrexp  .flag]  =check(cl ,  c2 ,  c3 ,  c4 ,  snmom,  sigsnr) 
save  opwdata  cl  c2  c3  c4  PDO  PFAO  snrexp  sigsnr  sig  . . . 
snmom  D  Nsub; 

writef il (count , c 1 , c2 , c3 , c4, snrexp , PDO , PFAO . sigsnr . sig, 
snmom  ,D ,  Nsub)  ; 

else 

PD0”cl/(cl+c2) ; 

PFA0=c4/(c3+c4) ; 

if  PD0<1  &  PDO>0  k  PFA0<1  APFA0>0 
t2sig=erfinv(l-2*PFA0) ; 
snrexp=sqrt(2) ♦ (t23ig-erf inv( 1-2+PDO) ) ; 
sprintf(’PD0:7,5.4f  PFA0:7,5.4f  snrexp :  */.5 . 4f  ’ ,  ... 

PDO , PFAO , snrexp) 

end 

end 

if  flag”l  break;  end 
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154  else 

155  flag=l; 

156  break; 

157  end 

158  end 

159  PD0=(cl)/(cl+c2) ; 

160  PFA0=(c4)/(c3+c4) ; 

161  t2sig=erf inv(l-2*PFA0) ; 

162  snreip=sqrt(2)*(t2sig-erf inv(l-2*PD0)) ; 
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%  function  called  opmach  designed  to  run  opuhite  and  machperf. 

%  The  program  obtains  operator  and  machine  probability  of  detection, 
■/.  probability  of  false  alarm  and  graphs  them  for  comparison. 

•/. 


•/. 


•/.  INPUTS 
•/.  sig  (1,1) 

•/.  D  (1,1) 

y. 

•/.  n  (1,1)  = 

*/,  Hsub  (l,num)  = 

•/. 

y. 

y,  OUTPUTS 

y.  pDo  (1,1)  = 

y.  PFAQ  (1,1)  = 

y. 

y.  PDMQS  (100,1)  = 

y. 

y.  PFAH0S(  100,1)  = 

y. 

y. 


Input  pixel  value  of  target 

Diameter  of  circular  disc  to  be  used  in  defining  the 

filter;  D  must  be  odd. 

number  of  displays 

number  of  pixels  on  the  x  aixis. 


Probability  the  operator  had  a  true  detection 
Probability  the  operator  thought  there  was  a 
target  but  there  was  none 

Probability  of  true  detection-report  by  optimum 
filter  at  operator  signal 

Probability  of  false  detection-report  by  optimum 
filter  at  operator  signal 


y. 

y,  [PDO, PFAQ, PFAMOS  ,PDH0S]=opmach(n,Haub,D  ,sig) 


f unct  ion  [PDO ,  PFAO ,  PFAMOS ,  PDMOS]  =op)iiach(n ,  Nsub ,  D ,  s  ig)  ; 
load  start 

[PDO , PFAO , snrbar , sigsnr , snrexp , cl , c2 , c3 , c4] =opnwhit e (n, sig , z , D , Hsub) ; 
[PDMOS , PFAMOS] =machparf ( s ig , D , z ,PD0 , PFAO , Hsub , ssow) ; 

H=prbprb(PFA,PD) ; 
prbprb (PFAO , PDO , H ,’ ro ’) : 
prbprb (PFAMOS , PDMOS , H ,’ g- ') : 
load  fnum; 

f  ig=sprintf  ( ’  exp#'/,! .  Of  ’ ,  fnum) 


PDGEN 

2  %  Function  called  PDgen  used  to  calculate  a  set  of  random  error 

3  y,  results  for  the  estimated  PDO,  PFAO  operator 

4  */,  performance  results. 

5  •/. 

6  •/. 


7 

•/,  INPUTS 

8 

•/.  n  (1,1) 

=  number  of  trials 

9 

•/.  Hsub  (1,1) 

=  size  of  background  matrix  to  display 

10 

•/.  sig  (1,1) 

=  target  signal  level 

11 

•/.  pill  (1,1) 

=  box  containing  the  signal  disc  at  the  center 

12 

•/.  D  (1,1) 

=  target  diameter 

13 

•/.  z  (266,256) 

=  backgroimd  to  display 

14 

15 

•/.  OUTPUTS 

16 

•/,  sigsnr (1,1) 

=  standard  deviation  of  random  snr  results 
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17  ■/,  snrbarCl,!)  =  mean  value  of  random  snr  results 

18  */.  sig  (1,1)  =  target  signal  level  to  conduct  experiment  with 

19  •/. 

20  ‘/.  [PDQ ,PFAO]=PDgen(n,Hsub ,D , sig, z, pill ,H) 

21 

22  function  [PDQ, PFAO]=PDgen(n,Nsub,D, sig, z, pill) 

23  [cl ,c2 ,c3,c4, flag, PDQ, PFAQ]=exopr3 (n/5,H3ub,D , sig, z, pill) ; 

24  sprintfCPDQ  is  ;y.5.4f  PFAQ  is;y.5.4f '  ,PDQ,PFA0) 

25  more  =  inputC’do  you  want  to  try  again?  (y/n)  ;  »’,’s’); 

26  while  more  ==  ‘y‘ 

27  nn=input(’ enter  number  of  trials  to  conduct’); 

28  3ig2=input(’ enter  the  signal  you  want  to  use’); 

29  [cl , c2, c3, c4, f lag, PDQ , PFAQ] =exopr3(nn,Hsub,D,3ig2,z, pill) ; 

30  sprintfC’PDO  is  :y.5.4f  PFAQ  i3:y.5.4f  ’  ,PD0,PFA0) 

31  more  =  inputC’do  you  want  to  try  again?  (y/n);  »’,’s’); 

32  end 

33  if  more==’n’&  PDQ=1 

34  PD0=.999; 

35  elseif  mora=’n’ft  PFAQ=0 

36  PFAQ=.001; 

37  end 


PDSNREST 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 


nvxixixi:ix/:/xixi:i:/x/:/xm 


y.  Function  called  pdsnrest  used  to  calculate  a  set  of  random  error 
y,  results  for  the  operator  (PD,PFA)-pair. 

y. 


y.  INPUTS 
y.  n  (1,1)  = 

y.  Hsub  (1,1)  = 

y,  sig  (1,1)  = 
y.  pill  (1,1)  = 
y.  M  (1,1)  = 
y.  D  (1,1)  = 

y,  z  (256,256)  = 

y. 

y.  OUTPUTS 
y,  sigsnrd,!)  = 
y,  snrbard,!)  = 

y,  sig  (1,1) 

y. 


uumber  of  trials 

size  of  background  matrix  to  display 
target  signal  level 

box  containing  the  signal  disc  at  the  center 
number  of  monte  carlo  simulations  to  be  run 
target  diameter 
background  to  display 


standard  deviation  of  random  snr  results 

mean  value  of  random  snr  results 

target  signal  level  to  conduct  experiment  with 


y,  [sigsnr , snrbar ,  sig]  =pdsnrest (n, Hsub ,D ,sig, z ,pill  ,H) 


function  [sigsnr, snrbar, sig]=pdsurest(n, Hsub, D, sig, z, pill, M) ; 
if  "existCM’);  H=le3;  end 

[cl,c2,c3,c4, flag, PDQ, PFAQ] =exopr3 (n/5 , Hsub , D , sig , z , pill ) ; 
sprintf(’PD0  is  :y.5.4f  PFAQ  is:y,5.4f  ’  ,PDO,PFA0) 
more  =  inputCdo  you  want  to  try  again?  (y/n);  »’,’s’); 
while  more  =  ’y’ 

nn”input(’ enter  nuid>er  of  trials  to  conduct’); 
slg2=input  ( ’ enter  the  signal  you  want  to  use ’ ) ; 

[cl , c2 , c3 , c4 , f lag , PDQ , PFAQ] =exopr3(im, Hsub ,D , sig2 , z ,pill) ; 
sprintf(’PDa  is  ;y,5.4f  PFAQ  is:7,5.4f’ , PDQ, PFAQ) 
more  =  input(’do  you  want  to  try  again?  (y/n);  »’,’s’): 
end 

if  more==’n’  t  PD0<1  t  PFAQ>0 
hN=n/2; 

R=rand(l,hH*M) ; 
ii=R<PD0 ; 

ii=reahapo(ii,hH,M) ; 

TT=sum(ii) ; 

R=rand(l ,hH*M) ; 
pnfanom=PD0; 
ii=R<pnf  anom; 
ii=reshapo(ii,hH,M) ; 
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44  ^=311111(11) ; 

45  ii=find(TT==hNlTT==0): 

46  TT(ii)  =  n: 

47  mi(ii)  =  n: 

48  ii=fiiid(NN==hNiNN==0) : 

49  TT(ii)  =  n: 

50  NN(ii)  =  n; 

51  PD=TT/hH; 

52  PFA=l-HH/liN; 

53  t2sig=erfinv(l-2*PFA) ; 

54  s23ig=-erf inv(l-2+PD)+t2sig; 

55  raiisnr=32sig+sqrt(2)  ; 

56  snrbar=meaii(ransiir) ; 

57  sigsnr=std(raiisnr) ; 

58  if  exist (’sig2’)  sig=sig2:  end 

59  A=100; 

60  CQ ,  H  =M3t  (ransnr ,  A)  ; 

61  Q=q(l:A-l): 

62  X=X(1:A-1): 

63  Q=cuiii3Um(Q)  : 

64  Q=q/q(length(Q)) : 

65  linprb(q,X); 

66  figure(gcf): 

67  end 
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'/,  Function  called  psdgen  used  to  develop  a  two  dimensional  power 
•/,  spectral  density  (pad)  from  a  two  dimensional  background  scene.  Based 
'/.  on  the  assuB^tion  of  isotropy  a  one  dimensional  result,  pad  versus 
%  spatial  frequency  magnitude,  is  developed.  A  single  scene  is  used  and 
%  ensemble  averaging  is  "accomplished"  by  averaging  over  a  ring  in 
■/.  spatial  frequency  space.  The  program  uses  spline  interpolation  on  the 
*/,  calculated  set  of  psd  values  to  generate  a  two  dimensional  array  of 
'/,  psd  values  corresponding  to  the  frequencies  of  the  two  dimensionnal 
'/,  FFT  of  the  input  background  scene. 

•/. 

•/. 

•/,  INPUTS 

"/,  H  (1,1)  =  Number  of  spatial  frequencies 

'/.  z  (256,256)  =  Background  scene 

•/, 

•/. 

'/,  OUTPUTS 

•/,  PSD  (256,256)  =  2-D  version  of  psd 

•/. 

y,  PSD-psdgen(N,z) 

function  PSD=psdgen(N,z) ; 
zz='fft2(z) ; 

k=0:127:  k=*Ck  -fliplr(k+l)]  ; 

k=ones(256,l)*k; 

k“k .'2;  k-k+k’ ;  k=sqrt (k) ; 

f=128*sqrt(2)*(l:H) /N; 

df»(f(2)-f(l))/2; 

p3d=*n  ; 

for  n=l:H 

ii”  f  ind(k>f (n)-df  t  k<=f(n)+df); 
psd  =  [psd  sum((aba(zz(ii))) . ‘2)/length(ii)] ; 
end 

psd(35)= (psd(34) +psd(36) ) /2 ; 
k=k(: )  : 

PSD=spline(f ,psd,k) ; 

PSD=reshape (PSD ,256,256); 
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APPENDIX  C  SPOTC 


This  appendix  contains  a  printout  of  the  programs  written  which  support  experiment  3.  This 
experiment  uses  SPOT  background  images.  The  control  program  is  OPMACH.  This  program  calls 
programs  called  OPCAM  and  MACHPERP.  The  OPCAM  program  collects  the  operator  (Pd,Pfa)- 
pair  and  the  MACHPERF  program  collects  the  machine  (PD,PF.4)-pairs. 

The  OPCAM  program  provides  the  operator  with  a  training  phase  then  when  the  operator 
feels  comfortable  with  target  recognition  the  program  begins  the  experimental  phase.  The  OP¬ 
CAM  program  interfaces  with  the  operator  through  the  keyboard  and  the  computer  monitor.  The 
computer  monitor  displays  eighteen  target/background  images,  and  a  decision  box  for  the  opera¬ 
tor  to  input  his  choice  of  target  present  or  not  present.  OPCAM  calls  the  programs  MAKEPILL, 
PDSNREST  and  EXOPR3.  PDSNREST  estimates  the  effective  (PD,PFA)-pair  of  an  xperiment. 
PDSNREST  allows  the  operator  to  have  as  many  training  trials  as  he  requests.  The  program  also 
allows  the  operator  to  adjust  the  target  signature  strength  so  that  the  effective  (PD,PFA)-pair  is 
close  to  the  nominal  (PD,PFA)-pair.  The  PDSNREST  calls  the  program  EXOPR3  which  serv'es  as 
the  interface  between  the  monitor  and  the  operator  and  collects/calculates  the  operator  effective 
(PD,PFA)-pair.  The  EXOPR4  program  serves  as  the  interface  between  the  operator  and  the  com¬ 
puter  monitor  for  the  experimental  data  collection  phase  of  the  experiment.  This  program  collects 
the  effective  (PD,PFA)-pair  collected  as  data.  EXOPR4  calls  the  programs  CHECK,  WRITEFILE, 
CAMO,  SHOW,  SCALE(1,2,3),  MTAR.  MTAR  adds  a  target  of  uniform  signature  to  the  back¬ 
ground  pixels.  The  MACHPERF  program  contains  the  algorithm  to  implement  the  machine/filter. 
The  MACHPERF  program  in  effect  offers  the  same  target/background  definitions  and  parameters 
to  the  machine/ filter  as  those  shown  to  the  operator.  The  MACHPERF  program  calls  the  programs 
PSDGEN,  MAKEPILL,  CAM.  MAKEPILL  and  CAM  serve  the  same  purpose  as  in  the  operator 
collection  phase.  The  program  PSDGEN  calculates  the  background  matrix  spatial  frequency  power 
spectral  density  (PSD)  which  is  then  used  to  implement  the  optimum  linear  filter. 


EXPERIMENT  3 


OPMACH 


%  function  called  opmacti  designed  to  run  opvhite  aoH  macl^orf. 

L  The  program  obtains  operator  and  machine  probability  of  detection, 
yf  probability  of  false  alarm  and  graphs  them  for  comparison. 

*/. 

•/. 

•/.  IHPUTS 


8 

'/.  sig 

(1,1) 

=  Input  pixel  value  of  target 

9 

•/.  D 

(1,1) 

-  Diameter  of  circular  disc  to  be  used  in  defining 

10 

•/. 

the  filter;  D  must  be  odd. 

11 

7.  n 

(1,1) 

3  number  of  displays 

12 

Hsub 

(1  ,nnm) 

=  number  of  pixels  on  the  x  axis. 

13 

7. 

14 

7. 

15 

7.  OUTPUTS 

16 

7.  PDO 

(1,1) 

=  Probability  the  operator  had  a  true  detection 

17 

7.  PFAO 

(1,1) 

=  Probability  the  operator  thought  there  was  a 

18 

7. 

target  but  there  was  none 

19 

7.  PDMOS 

(100,1) 

=  Probability  of  true  detection-report  by  optimum 

20 

7. 

filter  at  operator  signal 

21 

7.  PFAMOSC  100,1) 

=  Probability  of  false  detection-report  by  optimum 

22 

7. 

filter  at  operator  signal 

23 

7. 

24 

7. 

25 

*!%  CPDO  ,PFA0  ,PFAM0S » PDMOS!)  =opoiach(ii,Nsub,D ,  sig) 

26 
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27 

28  function  [PDO ,PFA0, PFAMQS .PDMOS ,signi]=opinach(n,Hsub,D ,sig)  ; 

29  load  start; 

30  [PDO , PFAO , snrbar , sigsnr , snrexp , cl , c2 , c3 , c4] =opcam(n, sig , z , D , Nsub) ; 

31  [PDHOS ,PFAM0S , sigm] ^machperf (sig.D ,z , PDO , PFAO ,Nsub  ,ssow) ; 

32  H=prbprb(PFA,PD) ; 

33  prbprb (PFAO, PDO, H, ’ro') : 

34  prbprbCPFAMOS , PDMOS ,H , ^g* O ; 

35  load  fnum; 

36  f  ig=sprintf  (’exp#'/,l  .Of  ’  ,fiium) 
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*/,  Function  called  opcam  designed  to  check  the  efffective 
y,  signeil-to-noise  (snreff)  of  an  experiment.  The  function  calculates  an 
*/.  operator, s  snreff  from  the  error  function  and  the  calculated 
y,  (PD,PFA)-pair.  The  program  then  conqjares  this  value  uith  nominal 
y,  signal-to  noise-ratio  (snmom)  of  the  to  see  if  the  operator  is 
y.  within  an  acceptable  limit  (2  standard  deviations) . 


y. 


y. 


y.  INPUTS 

y.  n  (1,1)  =Total  number  of  operator  trials  used  in  the  experiment 
y,  sig  (1,1)  =Target  signal  level 

y,  D  (1,1)  =Target  radius 

y,  Msub  (1,1)  =Si2a  of  background  matrix  to  display 
y,  z  (256,256)=background  to  display 


y.  OUTPUTS 

y,  snrexpd,!)  =  Signal  to  noise  ratio  that  the  operator  performs  uith 
y,  during  the  experiment,  (snreff) 
y,  sigsnrd,!)  =  Standard  deviation  of  the  snmom 
y,  snrbard.l)  =  average  snmom 

y,  PDO  (1,1)  =  operator  probability  of  detection 

y,  PFAO  (1,1)  =  operator  probability  of  false  alarm 

y,  cl  (2,1)  =  number  of  times  target  was  present  and 
%  detected 

y,  c2  (2,1)  =  number  of  times  target  was  present  and  not 
%  detected 

y,  c3  (2,1)  =  number  of  times  no  target  and  no  detection 

y,  c4  (2,1)  =  number  of  times  no  target  and  false  detection 

y. 


y. 

y.  [PDO, PFAO, snrbar, sigsnr, snrexp, cl, c2,c3,c4]=opcam(n, sig, z,D, Nsub)  ; 


function  [PDO, PFAO, snrbar, sigsnr, snrexp, cl, c2,c3,c4]=  ... 

opcam(n, sig, z,D, Nsub) ; 
pill=makepill(Nsub,D) ; 

[sigsnr, snrbar , sig] >pdsnrest(n, Nsub, D, sig, z, pill) ; 

[cl, c2,c3,c4, flag, PDO, PFAO, snraxp]=exopr4(n,Hsub,D, sig. z,  . . . 
snrbar .sigsnr, pill) ; 
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y.y.y.y.y.y.y.y.y.y.y.yx/.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.yx/.yx/.yx/x/.y.y.yx/.y.y.y.y.y.y.y.y.% 


y.  Function  called  machperf  designed  to  analyze  performance  in  terms 
y.  of  PD/PFA  of  a  machine  in  looking  for  a  uniform  circular  disc  target 
y,  with  isgierfect  camouflage.  The  target  is  present  in  a  background 
scene  that  is  randomly  chosen. The  machine  uses  a  set  of  filter 
y,  weights  to  recognize  targets. 

y. 

y. 

y.  INPUTS 
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10  '/.  sig  (1,1)  =  Input  pixel  value  of  target 

11  '/,  D  (1,1)  =  Diameter  of  circular  disc  to  be  used  in  defining 

12  */,  the  filter;  D  must  be  odd. 

13  ■/.  z  (256,256)  =  Background  scene 

14  '/,  PDO  (1,1)  =  Operator  probability  of  detection 

15  '/,  PFAO  (1,1)  =  Operator  probability  of  false  alarm 

16  '/.  Hsub  (1,N)  =  Size  of  background  scene  to  display 

17  */.  filt  (Nsub,Nsub)=  filter  weight  array 

18  •/. 

19  •/.  OUTPUTS 

20  y,  PDHOS  (100,1)  =  Probability  of  true  detection-report  by  optimum 

21  y.  filter  at  operator  signal 

22  y,  PFAMOSdOO,  1)  =  Probability  of  false  detection-report  by  optimum 

23  y.  filter  at  operator  signal 

24  y,  sigm  (1,1)  =  signal  machine  needed  to  match  the  operator 

25  y,  performance 

26  y, 

27  y. 

28  y. 

29  y,  CPDMOS, PFAMQS,sigm]=machparf(sig,D,z, PDO, PFAO, Hsub, filt) : 

30 

31  function  [PDM0S,PFAM0S,3igm]=machperf (sig, D,z, PDO, PFAO, Nsub, filt) ; 

32  sigBFsig; 

33  R=(D-l)/2; 

34  RH=(K3ub-l)/2: 

35  x=(-RH:RH) . '2; 

36  x=onaa(aize(x’))*z: 

37  R2=x+x>; 

38  ii=find(R2<=R‘2) : 

39  L=length(ii) ; 

40  if  exist (  ’ss’): 

41  pill=makapill(Hsub,D) ; 

42  filt=pill: 

43  else  exist ( ’ssow’ ) ; 

44  pill=makepill(256,D) ; 

45  s='fft2(pill) : 

46  PSD=psdgen(50,z) ; 

47  ssow=real(ifft2(s./PSD)) : 

48  P=(129-(Ksub-l)/2) : (129+<Hsub-l)/2)  ; 

49  ssow=ssow(P,P) ; 

50  filt=ssow; 

51  end 

52  pd=256-Nsub; 

53  qd=256-H3ub ; 

54  Suml=  □  ; 

55  H=1000 ; 

56  x=n: 

57  y=  □  ; 

58  A=sum(filt(ii)) ; 

59  for  b=l:N 

60  X*  (RN+l)+pd*reuid<l,l) ; 

61  y"  (RN+l)+qd*rand(l,l) ; 

62  ca]B~camo(0,z,rand(l,l)  ,rand(l,l)) ; 

63  Z=  z(x-RH:x+RH,y-Rll:y+RH); 

64  Suml- [Suml ;  sum(sum(Z.*f ilt))] ; 

65  Z(li)-ones(size(Z(ii) ) )*mean(Z(ii))+cam; 

66  Su]i2~ iSu]ii2 ;  sum(sum(Z.*f  ilt))]  ; 

67  and 

68  Sums=  [Suml  Suin2-t-sigm*A]  ; 

69  T=linspace(miii(mln(Suiiis))  ,max(max(Sums))  ,  102)  ; 

70  T(102)  =  n: 

71  T(l)=n; 

72  PDMOS”  □  ; 

73  PFAMOS-D; 

74  for  b=l:100 

75  e”(T(b)  <  Sums) ; 

76  e“sum(e) ; 

77  PDM0S=[PDM0S  e(2)/H]: 
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78  PFAMOS=  [PFAMQS  eCD/Nl; 

79  end 


PSDGEN 


1 

2 

3 

4 

5 

6 

7 
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9 

10 

11 
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14 

15 

16 
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28 

29 
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*/,  Function  called  psdgen  used  to  develop  a  two  dimensional  power 
spectral  density  (psd)  from  a  two  dimensional  background  scene. 

Based  on  the  assuag>tion  of  isotropy  a  one  dimensional  result,  psd 
versus  spatial  frequency  magnitude,  is  developed.  A  single  scene  is 
used  and  ensemble  averaging  is  "accoii5)lished“  by  averaging  over  a 
ring  in  spatial  frequency  space. The  program  uses  spline  interpolation 
on  the  calculated  set  of  psd  values  to  generate  a  two  dimensional 
array  of  psd  values  corresponding  to  the  frequencies  of  the  two 
dimensionnal  FFT  of  the  input  background  scene. 


•/. 


•/. 

*/.  IHPUTS 

*/,  N  (1,1)  =  Number  of  spatial  frequencies 

y.  z  (256,256)  =  Background  scene 

•/. 

•/. 

y.  OUTPUTS 

y.  PSD  (256,256)  =  2-D  version  of  psd 

y. 

y,  PSD=psdgen(N,z) 


function  PSD=psdgen(N,z) ; 
zz=fft2(z) : 

k=0:127:  k=Dc  -fliplr(k+l)]  ; 

k=one3(256,l)*k; 

k=k.‘2;  k=k+k’ :  k=sqrt(k) ; 

f=128*sqrt(2)*(l :N)/H; 

df=(f(2)-f(l))/2! 

psd“0 : 

for  n=l:H 

ii=  f  ind(k>f  (n)-df  tc  k<=f(n)+df); 

psd  =  [psd  sum((ab3(zz(ii))) . ■2)/length(ii)]  ; 

end 

psd(35) = (psd(34) +psd(36) ) /2 ; 
k=k(:) ; 

PSD=splina(f ,p3d,k) ; 

PSD=re3hapa (PSD , 256 , 256) ; 


EXOPR3 
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y,  function  called  ezopr3  used  to  collect  pd/pfa  related  data.  This 
y,  function  will  display  three  series  of  target  images.  The  first  series 


y,  displays  a  circular  disc  target  in  a  background  pattern.  The  second 
y,  series  displays  a  circular  disc  target  in  a  background  pattern  where 
"U  the  background  and  target  are  between  the  mininnim  pixel  value  and  the 
y,  mean  value  of  the  pixels.  The  third  series  displays  a  circular  disk 
y,  target  in  a  background  pattern  where  the  disc  and  the  background 
y,  pattern  are  between  the  mean  background  pixel  value  and  the  maximum 
y,  background  pixel  value.  The  monitor  display  is  designed  to  provide 
y,  the  operator  with  the  equivalent  of  a  color/contrast  control  knob, 
y.  The  function  collects  operator  performance  numbers  from  which  pd  and 
y,  pfa  are  cedculated.  The  data  collection  is  based  on  some  specified 
y,  number  of  separate  displays.  This  program  is  designed  for  the 
y,  pre-experiment  stage  when  the  operator  is  being  trained  and  PD, PFA 
y,  are  being  verified. 

y. 


y,  INPUTS 

y.  n  (1,1) 

y,  Hsub  (1,1) 

y.  D  (1,1) 


=  number  of  displays 

=  size  of  the  background  scene  for  display. 
=  circle  Diameter 
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22  '/,  sig  (1,1)  =  Target  signal 

23  */,  z  (256,256)  =  Random  image  field 

24  ■/,  ss  (Nsub,Nsub)=  Box  containing  signal  disc  at  center 

25  •/. 

26  •/. 

27  •/.  OUTPUTS 

28  */.  cl  (2,1)  =  number  of  times  target  was  present  and 

29  ■/.  detected 

30  */.  c2  (2,1)  =  number  of  times  target  was  present  and  not 

31  */.  detected 

32  ‘/,  c3  (2,1)  =  niimber  of  times  no  target  and  no  detection 

33  "/,  c4  (2,1)  =  number  of  times  no  target  and  false  detection 

34  */,  flag  (1,1)  =  emergency  exit  indicator, 

35  */.  (l/0)=(e-exit/norm-end) 

36  */.  PD  (1,1)  =  Probability  the  target  was  present  and  the 

37  y,  operator  identified  it 

38  y.  PFA  (1,1)  =  Probability  the  target  was  not  present  but 

39  y,  the  operator  thought  it  was  present 

40  y. 

41  y. 

42  y,  [cl ,  c2  ,c3 ,  c4  ,f  lag,PD  ,PFA]=exopr3(n,H3ub,D,sig,z,ss) 

43 

44 

45 

46  function  Ccl,c2,c3,c4,flag,PD,PFA]=exopr3(n,Nsub,D,sig,z,ss) ; 

47  if  n>25  n=25:  end; 

48  R=(D-l)/2i 

49  cl=0;c2=0;c3=0;c4=0; 

50  cla,clg,aiis(’off ’) : 

51  flag=0i 

52  count'lj 

53  for  k=l;n 

54  if  flag  ==  1  end 

55  T=(rand(l,l)>0.5) : 

56  cla.clg; 

57  kx=rand(l ,1) ; 

58  while  kx==l ; 

59  kx=rand(l ,1) ; 

60  end 

61  ky=rand(l,l) ; 

62  while  ky==l ; 

63  ky”rand(l ,1) : 

64  end 

65  if  T  cam=camo(D,z,kx,ky) ;end 

66  j j=find(ss==l) ; 

67  [mm,SD,zpl]=mtar(Nsub,D,z,ki,ky) : 

68  if  T  zpl(jj)=mean(zpl(jj))+cam;  end; 

69  zsl=zpl+(3s*aig*T) ; 

70  3ubll=scalingl(zsl,mm,SD, .01,R) ; 

71  showr(subll,.025,.05,.14,.3,(D-l)/2); 

72  subll=scalingl(zsl,iim,SD,l,R) ; 

73  ahowr(3ubll,.19,.05,.14,.3,(D-l)/2): 

74  subll=scalingl(zal,mm,SD,1.5,R) : 

75  3howr(3ubll,.356,.05,.14,.3.(D-l)/2); 

76  subll=scalingl(zsl,mm,SD,2,R) ; 

77  showr(subll,.52,.05,.14,.3,(D-l)/2); 

78  subll=scalingl(zsl,mm,SD,2.5,R) ; 

79  showr(subll,.685,.05,.14,.3.(D-l)/2): 

80  subll=scalingl(zsl,mm,SD,3,R) ; 

81  ahowr(subll,.85,.05,.14,.3.(D-l)/2): 

82 

83  Dnml.SDl  ,zp2]=]iitar(Hsub,D,z,kz,ky) ; 

84  if  T  zp2(jj)=mean(zp2(jj))+cajn:  end; 

85  z32=zp2+(ss*aig*T) ; 

86  [3nbl2, scale] =3caling2(z32,mm1 ,SD1,1.4,R)  ; 

87  showr (subl2 ,.025,.35..14,.3,<D-l)/2): 

88  [3ubl2, scale] =scaling2(z32,mml ,SDl,(3cale+l) ,R) ; 

89  showr (3ubl2 ,.19,.35,.14,.3,(D-l)/2); 
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[subl2 .scale]  =3caling2(zs2,iimil ,SD1 , (scale+2)  ,R) 
sliowr Csubi2 ,  .355,  .35,  .14,  .3,  (D“l) /2)  ; 

[subl2 ,scale]=scaling2(zs2,imnl ,SD1 , (scale-i-3)  ,R) 
Stour (subl2 , . 52 , . 35 , . 14, .3, (D-l)/2) ; 

[subl2  .scale]  =scaling2 (zs2 .nrnil , SDl , (scale+4)  , R) 
showr (subl2 , .685 , .35 , . 14, .3. (D-1) /2)  ; 

[subl2 ,scale]=scaliiig2(zs2,nmil ,SD1 , (scale+5)  ,R) 
showr (subl2 , .85 , . 35 , . 14, .3 , (D-l)/2) ; 


[imB2,SD2,zp3]=mtar(Nsub,D,z,lcit,k7)  : 
if  T  zp3(jj)=meaii(zp3(j j))+cam;  end; 
zs3=zp3+(ss*aig*T) ; 

[!subl3  ,sC2j.e]=scaliiig3(zs3,mm2,SD2 ,  .5,R)  ; 
showr (subl3 , .025 , .65 , . 14, .3, (D-l)/2) ; 

C3ubl3  ,scaLle]  =scaliiig3 (z33  ,mm2 ,SD2 ,  (3cale+l)  , R).; 
showr (3ubl3, .19, .65, . 14, .3 , (D-l)/2) ; 

[subl3 ,scala]=scaliiig3(z33,!imi2,SD2, (scale+1)  ,R) ; 
showr (subl3 , .355 , .65 , . 14, . 3, (D-l)/2) ; 
[aubl3,3cale]=3caliiig3(z33,imn2,SD2, (scale+1)  ,R)  ; 
showr (subl3 , . 52, . 65 , . 14, .3, (D-l)/2) ; 
Csubl3,3cale]=scaliiig3Czs3,mm2,SD2,(3cale+l)  ,R) ; 
showr (subl3 , . 685 , .65 , . 14, .3, (D-l)/2) ; 
C3ubl3,scale]=acaling3(z33,nmi2,SD2, (scale+1)  ,R)  ; 
3howr(subl3,.85,.65,.14,.3,(D-l)/2); 


dispC target  ntimber  is’): 
disp  (count) ; 

tgt  =  input (’is  there  a  target?  [(y/n);  '(y/n)  exits  test  loop] 
...  »’,’s’); 

if  (tgt=»’y’l  tgt”’n’) 
count=count+l ; 
if  T; 

if  tgt”=’y’ 

di8p( ’CORRECT’) ; 
cl=cl+l; 

else 

disp( ’WRONG’); 
c2=c2+l ; 

end 

else 

if  tgt=”’y’ 

di3p( ’WRONG’ ) ; 
c4=c4+l ; 

else 

disp(’CORRECT’) ; 
c3*c3+l ; 

end 

end 


else 

flag=l; 

break; 

end 


end 

PD=(cl)/(cl+c2); 
PFA=(c4)7(c3+c4)  ; 


EXOPR4 


3  %  function  will  display  three  series  of  target  images.  The  first  series 

4  %  displays  a  circular  disc  target  in  a  background  pattern.  The  second 

5  '/,  series  displays  a  circular  disc  target  in  a  backgromd  pattern  where 

6  */,  the  background  and  target  are  between  the  minimum  pixel  value  and  the 
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7  '/,  mean  value  of  the  pixels.  The  third  series  displays  a  circular  disk 

8  ■/.  target  in  a  background  pattern  where  the  disc  and  the  background 

9  '/,  pattern  are  between  the  maximum  background  pixel  value  and  the 

10  '/.  maximum  backgroimd  pixel  value.  The  monitor  display  is  meant  to 

11  '/.  provide  the  operator  with  the  equivalent  of  a  color  contrast  control 

12  '/.  knob.  The  function  collects  operator  performance  numbers  from  which 

13  '/,  pd  and  pfa  are  calculated. The  data  collection  is  based  on  some 


14 

specified  number  of  separate  displays.  The  collects  the  operator 

15 

(PD, PFA)-] 

pair  for  an 

for  an  experiment. 

16 

!. 

INPUTS 

17 

'/,  n 

(1,1) 

=  number  of  displays 

18 

■/.  Nsub 

(1,1) 

=  size  of  the  background  scene  for  display. 

19 

■/.  D 

(1,1) 

=  circle  Diameter 

20 

■/.  sig 

(1,1) 

=  Target  signal 

21 

/.  z 

(256,256) 

=  Background  scene  to  display  • 

22 

y.  snmom 

(1,1) 

=  nominal  signal  to  noise  voltage  ratio 

23 

y.  sigsnr 

(1,1) 

=  standard  deviation  of  the 

24 

y. 

signal-to-noise  ratio 

25 

y.  S3 

(Haub  ,Hsiib) 

=  Box  containing  signal  disc  at  center 

26 

y. 

27 

y. 

28 

y. 

OUTPUTS 

29 

y.  cl 

(2,1) 

=  number  of  times  target  was  present  and 

30 

y. 

detected 

31 

y.  c2 

(2,1) 

=  number  of  times  target  was  present  and  not 

32 

y. 

detected 

33 

y.  c3 

(2,1) 

=  number  of  times  no  tctrget  and  no  detection 

34 

y.  c4 

(2,1) 

=  number  of  times  no  target  and  falsa 

35 

y. 

detection 

36 

y.  flag 

(1,1) 

=  emergency  exit  indicator. 

37 

y. 

(l/0)=(e-exit/norm-end) 

38 

y.  PDo 

(1,1) 

=  Probability  the  target  was  present  and  the 

39 

y. 

operator  identified  it 

40 

y,  PFAQ 

(1,1) 

=  Probability  the  target  was  not  present  but 

41 

y. 

the  operator  thought  it  was  present 

42 

y,  snrexp 

(1.1) 

=  Signal  to  noise  voltage  ratio  of  the 

43 

y. 

operator  during  the  experiment 

44 

y. 

45 

y. 

46 

y,  [cl,c2,c3 

,c4, flag, PDO, PFA0.3nrexp]=exopr4(n,H3ub,D, sig, z,  . . . 

47  */■  snmom,sigsnr,ss) 

48 

49  function  [cl,c2,c3,c4.flag,PD0,PFA0,snrexp]=exopr4(n,Hsub,D,sig,z,  ... 

50  snmom,sigsnr,ss) ; 

51  R=(D-l)/2: 

52  cl=0;c2=0:c3=0;c4=0! 

53  cla,clg,azi3(’off ’) ; 

54  f lag=0 ; 

55  count=l; 

56  for  k=l:n 

57  if  flag  “  1  end 

58  T=(rand(l,l)>0.5); 

59  cla.clg; 

60  lomrandCl,!) ; 

61  while  ki™!: 

62  kx=rand(l,l); 

63  end  * 

64  ky=rand<l,l) ; 

65  while  ky=l ; 

66  ky^andCl.l); 

67  end 

68  if  T  ca]ii~camo(D,z,kx,ky)  ;end 

69  j  j*find(ss”l) ; 

70  Diim,SD,zpl]=mtar(Hsub,D,z,kz,ky) ; 

71  if  T  zpKj j)=mean(zpl(j j))+cam;end 

72  zsl*=zpl+(as*sig+T) ; 

73  3ubll=scallngl(z3l,iiin,SD,  .01,R) ; 

74  3howr(subll, .025, .05, . 14, .3, (D-l)/2) ; 
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75  subll=scalingl(2sl ,nim,SD ,  1  ,R)  ; 

76  shovrCsubll . . 19, .05, . 14, .3, (D-l)/2) ; 

77  subll=scaliiigl(zsl,iim,SD,1.5,R) ; 

78  sbowrCsubll , . 355 , .05, . 14, .3, (D-l)/2) ; 

79  sTibll=scaliiigl(z3l  ,min,SD  ,2,R)  ; 

80  sliowr(subll,.52.  .05,.14,  .3,(D-l)/2)  ; 

81  3ubll=scalingl(zsl,mm,SD,2.5,R) ; 

82  showr (subll , . 685 , . 05 , . 14 , .3 . (D-1) /2) ; 

83  subll=scalinglCzsl ,mm,SD,3,R) : 

84  sbowr (subll , . 85 . . 05 , . 14, . 3 , (D-l)/2) ; 

85 

86  l!mml,SDl  ,zp2]=i[ttar(N3ub,D  ,z,ki,ky)  ; 

87  if  T  zp2(j j)=inean(zp2(j j))+cani:end 

88  Z32=2p2+(ss*sig*T) ; 

89  [3Ubl2, scale]  =scaliiig2(z32,mml  ,SD1,1.4,R)  ; 

90  sbovr (subl2 , . 025 , . 35 , . 14 , .3 , (D-1) /2) ; 

91  [3Ubl2, scale] =scaling2 (z32, mml  ,SD1 , (scale+1) ,R) ; 

92  showr (subl2 , . 19 , . 35 , . 14 , . 3 , (D-1) /2) ; 

93  [3Ubl2, scale]  =scaliiig2(z32, mml  ,SD1,  (scale+2)  ,R) ; 

94  showr(subl2,.35S,.35,.14,.3,(D-l)/2); 

95  [subl2, scale] =scaling2(zs2,mml  ,SD1 , (scale+3) ,R) ; 

96  showr (subl2 , . 52 , . 35 , . 14 , . 3 , (D-l)/2) ; 

97  Csubl2, scale]  =scalitig2(zs2, mml  ,SD1,  (scale+4)  ,R) ; 

98  showr (subl2 , . 685 , .35 , . 14 , .3 , (D-l)/2) ; 

99  [subl2,scale]=scaling2(z32,mml,SDl,(scale+5) ,R) ; 

100  showr (3ubl2 , . 85 , . 35 , . 14 , . 3 , (D-1) /2) ; 

101 

102  [mm2,SD2 ,zp3]=mtar(Nsub,D,z,kr,k7) ; 

103  if  T  zp3(j j)=maan(zp3(j j))+'cam;and 

104  z33=zp3+(s3*3ig*T) ; 

105  C3ubl3,3calo]=scaling3(zs3,mm2,SD2,l,R) ; 

106  showr (3Ubl3 , . 025 , . 65 , . 14 , . 3 , (D-1) /2) ; 

107  Csubl3,3cale]=scaliiig3(z33,mm2,SD2,  (scale+.S)  ,R)  ; 

108  showr (3Ubl3, . 19, .65, . 14, .3, (D-l)/2) ; 

109  Csubl3,scale]-scallng3(zs3,mm2,SD2,(scale-f'.75)  ,R) ; 

110  showr (8ubl3 , . 355 , . 65 , . 14 , . 3 , (D-1) /2) ; 

111  [subl3,scalo]=scaliiig3(z33,mm2,SD2,(scala+l)  ,R) ; 

112  showr (subl3, . 52, .65 , . 14, .3, (D-l)/2)  ; 

113  [subl3,scale]=scaliiig3(zs3,min2,SD2,(3cale+1.5)  ,R)  ; 

114  showr (subl3 , . 685 , . 65 , . 14 , . 3 , (D- 1 ) /2) ; 

115  Csubl3,scale]=scaliiig3(zs3,mm2,SD2,(scale'i-2)  ,R)  ; 

116  showr(3Ubl3,.85,.65,.14..3,(D-l)/2); 

117 

118  dispCtarget  number  is’); 

119  disp  (count); 

120  tgt  =  input (’is  there  a  target?  [(y/n) ;  "(y/n)  exits  ... 

121  test  loop]  »’,’s’); 

122  if  (tgt=»’y’l  tgt”-’n’) 

123  count*count+l ; 

124  if  T; 

125  if  tgt”’y’ 

126  disp( ’CORRECT’) ; 

127  cl-cl+1; 

128  else 

129  disp( ’WRONG’ ) : 

130  c2-c2+l : 

131  end 

132  else 

133  if  tgt”’y’ 

134  disp( ’WRONG’ ) ; 

135  c4=c4+l ; 

136  else 

137  disp(’CORRECT’) ; 

138  c3=c3+l : 

139  end 

140  end 

141  if  count=floor(n/5)  I  count=floor(2*n/6)  I  count=  . 

142  floor (3*n/5)  I  count=>=floor(4*n/5)  |coimt==n; 
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143  [PD0,PFA0,siirexp,flag]=check(cl,c2,c3,c4,snniom,sigsnr)  ; 

144  save  opwdata  cl  c2  c3  c4  PDO  PFAO  snrexp  sigsnr  sig  . . . 

145  snmom  D  Nsub; 

146  writefiKcount, cl, c2,c3,c4, snrexp, PDO, PFAO, sigsnr, sig,  ... 

147  snmom, D, Nsub ) ; 

148  else 

149  PD0=cl/(cl+c2) : 

150  PFA0=c4/(c3+c4) : 

151  if  PDQ<1  &  PDO>0  &  PFA0<1  JePFAO>0 

152  t2sig=erf inv(l-2*PFAQ) ; 

153  snrexp=sqrt(2)*(t2sig-erfinv(l-2*PD0)) ; 

154  sprintf  (’PD0:'/.5.4f  PFAQ;7.5.4f  snrexp:7.5.4f  ’  ,PD0,  ... 

155  PFAO, snrexp) 

156  end 

157  end 

158  if  flag==l  break;  end 

159  else 

160  flag=l: 

161  break; 

162  end 

163  end 

164  PDQ=(cl)/(cl+c2) ; 

165  PFA0=(c4)/(c3+c4) ; 

166  t2sig=erfinv(l-2*PFA0) ; 

167  3nrexp=sqrt(2)*(t23ig-erfinvCl-2*PD0)) ; 


PDGEN 
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28 
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*/,  Function  called  PDgen  used  to  calculate  a  set  of  random  error 
y,  results  for  the  estimated  PDO,  PFAO  operator 
y,  performance  results. 

y. 


y. 

y,  INPUTS 
y.  n  (1,1) 
y.  Nsub  (1,1) 

y.  sig  (1,1) 
y.  pill  (1,1) 
y.  D  (1,1) 

y.  z  (256,256) 

y. 

y.  OUTPUTS 
y.  sigsnrd,!) 
y,  snrbard,!) 

y,  sig  (1,1) 

y. 


number  of  trials 

size  of  background  matrix  to  display 
target  signal  level 

box  containing  the  signal  disc  at  the  center 
target  diameter 
background  to  display 


standard  deviation  of  random  snr  results 

mean  value  of  random  snr  results 

target  signal  level  to  conduct  experiment  with 


y.  [PDO , PFAO] =PDgen(n, Nsub ,D , sig. z .pill ,M) 


f unct ion  [PDO , PFAO] =PDgen(n , Nsub , D , sig , z , pill) 

[c 1 , c2 , c3 , c4 .flag , PDO , PFAO] =exopr3 (n/5 , Hsub , D , sig , z , pill) ; 
sprintfdPDO  is  :y,S.4f  PFAO  is : . 4f  > , PDO , PFAO) 
more  =  input(’do  you  want  to  try  again?  (y/n) ;  »’,’s’): 
while  more  =•  ’y’ 

nn“tnput(’ enter  number  of  trials  to  conduct’); 

3ig2=input( ’enter  the  signal  you  want  to  use’); 

[cl ,  c2,c3,c4, flag, PDO, PF AO] =exopr3(nn, Nsub, D,sig2,z, pill) ; 
sprintf(’PDO  is  :y,S.4f  PFAO  i3:y,5.4f ’,PD0,PFAD) 
more  =  tnput(’do  you  want  to  try  again?  (y/n);  »’,’s’); 
end 

if  more==’n’fc  PDO^l 
PD0-.999; 

elseif  more=’n’t  PFA0=0 
PFA0=.001: 

end 
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PDSNREST 

*/,  Function  called  pdsnrest  used  to  calculate  a  set  of  random  error 
‘/,  results  for  the  estimated  operator  <PD,PFA)-pair.  The  program  first 
■/.  runs  a  set  number  of  trials  then  calcinates  the  operator 
'/,  experimental  (PD,PFA)-pair.  The  program  displays  the  experimental 
*/.  (PD  ,PFA) -pair  to  the  operator  and  allous  the  operator  to  adjust  the 
'/,  experimental  signal.  When  the  operator  is  satisfied  with  the 
'/,  experimental  (PD,PFA)-pair  the  program  use  this  experimental 
y,  (PD  ,PFA) -pair  to  calculate  the  effective  signal-to-noise  ratio 
y.  (called  snrbar  in  this  progriim)  and  the  standard  deviation  (sigsnr) 
snrbair . 


1 

2 
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6 
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8 
9 
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12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 
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62 

63 

64 

65 

66 


y.  of 

y. 

y.  INPUTS 

(1.1) 
(1.1) 
(1.1) 
(1.1) 
(1.1) 
(1.1) 
(256.256) 


number  of  trials 

size  of  background  matrix  to  display 
tzirget  signal  level 

box  containing  the  signal  disc  at  the  center 
number  of  monte  carlo  simulations  to  be  run 
target  diameter 
background  to  display 


y.  n 
y,  Nsub 

y.  Sig 
y.  pill 
y.  M 
y.  D 
y.  z 
y. 

y.  OUTPUTS 
y,  sigsnrd.l) 
y.  snrbard.l) 
y.  sig  (1.1) 

y. 

y,  [sigsnr . snrbar .  sig]=pdsnrest (n, Nsub, D , sig, z  .pill ,M) 


standard  deviation  of  random  snr  results 

mean  value  of  random  snr  results. 

target  signal  level  to  conduct  experiment  with 


function  [sigsnr .snrbar, sig]  =pdanreat(n, Nsub, D, sig, z, pill, M) ; 
if  ■exiat(>H>)i  H=le3!  end 

[cl,c2,c3,c4,flag,PD0, PFAO]  =exopr3 (n/5 , Nsub , D , sig, z , pill ) ; 
sprintfdPDO  is  :y,S.4f  PFAO  is:y3.4f  >  .PDO.PFAO) 
more  =  tnputddo  you  want  to  try  again?  (y/n) ;  »’,’8’)i 
while  more  ==  ‘y’ 

nn”input( ’ enter  number  of  trials  to  conduct’); 
sig2=input( ’enter  the  signal  you  want  to  use’); 

[cl ,c2,c3, c4. flag. PDO, PFAO]  =oxopr3(nn, Nsub, D,sig2,z, pill) ; 
sprintf(’PDO  is  :y,5.4f  PFAO  is:y,5.4f’ , PDO, PFAO) 
more  =  input  (’do  you  want  to  try  again?  (y/n);  »’,’s’); 
end 

if  more==’n’  ft  PD0<1  ft  PFA0>0 
hN=n/2: 

R=randd  ,hN*H) ; 
ii=R<PD0 : 

ii=reshape(ii,hH,M) ; 

TT=sum(ii) ; 

R=randd  ,hH*M) ; 
pnfanoilFPDO ; 
ii”R<pnfanom; 
ii”reshape(ii,hN,M) ; 

NN“sum(ii) ; 

ii-f  ind(Tr==hNlTT=0) ; 

TT(ii)>=n  : 

NN(ii)=n; 

ii=find(NN==hN|NN=-0) ; 

TT(ii)=n  : 

NN(ii)  =  n  ; 

PD=Tr/hH; 

PFA=l-NN/hH; 
t2sig=erfinvd-2+PFA) ; 
s2sig=-erf inv ( 1-2*PD) +t 2s ig ; 
ransnr=s2sig*sqrt(2) ; 
snrbair=mean(ransnr) ; 
sigsnr=std(rananr) ; 
if  exist (’sig2’)  sig=sig2;  end 
A=100; 
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67  [Q  ,H=hist  (ransnr  ,A)  ; 

68  Q=Q(1;A-1): 

69  X=X(1:A-1); 

70  Q=cuiiisum(Q)  ; 

71  Q=q/Q(len^h(Q))  ; 

72  linprb(Q,X); 

73  figure(gcf): 

74  end 


PSDGEN 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 


%  Function  called  psdgen  used  to  develop  a  two  dimensional  power 
spectral  density  (psd)  from  a  two  dimensional  background  scene. 

Based  on  the  assumption  of  isotropy  a  one  dimensional  result,  psd 
versus  spatial  frequency  magnitude,  is  developed.  A  single  scene  is 
used  and  ensemble  averaging  is  "accoii5)lishad"  by  averaging  over  a 
ring  in  spatial  frequency  space. The  prograun  uses  spline  interpolation 
on  the  calculated  set  of  pad  values  to  generate  a  two  dimensional 
array  of  psd  values  corresponding  to  the  frequencies  of  the  two 
dimens ionnal  FFT  of  the  input  backgrovmd  scene. 

•/. 


•/. 


•/,  IKPUTS 

y,  H  (1,1)  =  Humber  of  spatial  frequencies 

y,  z  (256,256)  =  Background  scene 

y. 

y. 

y,  OUTPUTS 

y,  PSD  (256,256)  =  2-D  version  of  psd 

y. 

y.  PSD=p3dgen(H,z) 


function  PSD=psdgeu(H,z) ; 

2Z=fft2(2) ; 

k=0:127;  k=li  -fliplr(k+l)] ; 

k=ones(256 , 1) *k; 

k=k.'2;  k=k+k’ ;  k=3qrt(k); 

f=128*sqrt(2)*(l:H)/N: 

df=(f(2)-f(l))/2: 

psd'D : 

for  n=l:H 

ii=  f ind(k>f (n)-df  t  k<=f(n)+df); 

psd  =  Cpsd  sum((abs(zz(ii))) . ‘2)/length(ii)]  ; 

end 

p3d(35)= (p3d(34) +psd(36) ) /2 ; 
k=k(: ) ; 

PSD=spline(f ,psd,k) ; 

PSD=reahape(PSD,256,256) ; 


CAMO 

y.  Function  called  camo.  Used  to  generate  a  zero  mean  camouflaged 
y,  disk  pattern.  The  pattern  corresponds  to 
y,  portion  of  the  scene. 


randomly  selected 


7  •/ 

INPUTS 

8  •/ 

D 

(1,1) 

9  •/ 

z 

(M,H) 

10  •/ 

ky 

(1,1) 

11  •/ 

kx 

(1.1) 

12  •/ 

13  •/ 

14  •/ 

:  OUTPUTS 

15  7 

•  cam 

(l,ii) 

=  Diameter  of  circle  region. 

=  Random  image  field. 

=  Random  number  (uniform, zero  to  one) 
s  Random  number  (uniform, zero  to  one) 


Randomly  chosen  piece  of  background  matrix. 
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16  •/. 

17  •/. 

18  •/. 

19  '/,  caiiF=camo(D,z,kx,ky) ; 

20 
21 

22  function  caiiF=camo(D  ,z,kx ,ky)  ; 

23  [>I,N]=3ize(z)  ; 

24  a=(D-l)/2: 

25  x=(-R:R).‘2; 

26  x=ones(3ize(x’))*x; 

27  R2=x+x': 

28  ii=find(R2<=R*2) ; 

29  L=length(ii) ; 

30  ni=l+R+floor((M-(D-l))*kx) ; 

31  n=l+R-t-floor((H-(D-l)  )*ky)  ; 

32  cam=z(m-R:iii+R,n-R:n+R)  ; 

33  mcirc=3U3n(cam(ii))/L; 

34  cam=cajn(ii)-mcirc; 


APPENDIX  C  COMMON  PROGRAMS 


This  appendix  contains  the  text  for  the  programs  which  are  shared  by  all  three  experiments.  The 
program  GLINES  plots  the  lines  on  the  probability  graph  which  correspond  to  a  signal-to-noise 
ratios  of  (TIO).  The  program  GAUSS  is  used  to  convert  probabilities  to  the  appropriate  value 
corresponding  to  their  location  on  the  prbprb  graph.  The  program  converts  probability  distributions 
to  the  corresponding  number  of  standard  deviations  of  a  gaussian  distribution.  The  program  called 
MAXMIN  is  used  to  find  the  appropriate  axes  scales  to  accomodate  the  entire  range  of  the  probability 
distribution  to  be  plotted.  The  program  PDPFAEFF  calculates  the  operator  effective  (PD,PFA)-pair 
using  ”  Monte  Garlo'’  techniques.  The  program  PRBPRB ER  plots  a  (PD,PFA)-pair  on  a  prbprb  graph 
with  error  bars.  The  program  PRPRLAER  plots  (PD,PFA)-pairs  on  a  prbprb  graph  with  labels  on 
the  effective  signal-to-noise  ratio  lines.  The  program  SNRGALG  calculates  the  signal  to  noise  ratio 
in  gaussian  noise  of  a  given  (PD,PFA)-pair  assuming  an  unbiased  threshold.  SNRESTER  estimates 
the  effective  snr  of  an  experiment  and  it’s  standard  deviation  based  on  ”  Monte  Garlo”  techniques  and 
the  number  of  experimental  trials.  MAKEPILL  outputs  the  matched  filter  of  a  disc  shaped  target. 
3  programs  (SGALEl,  SCALE2,  SCALE3)  each  scale  and  limit  the  target/background  images  prior 
to  display.  Each  scale  program  is  used  with  different  limits  to  display  six  background/target  images. 
The  three  programs  in  effect  serve  as  the  operators  color/contrast  control  knob.  SHOW  displays 
the  eighteen  background/ target  images  on  the  computer  monitor  in  greyscale  format.  WRITEFILE 
stores  the  experimental  data  to  both  a  text  and  a  data  file.The  program  CHECK  compares  the 
effective  signal-to-noise  ratio  of  an  experiment  with  the  nominal  signal-to-noise  ratio  and  allows  the 
operator  to  terminate  the  experiment. 


COMMON  PROGRAMS 


GLINES 
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*/,  function  called  glines  used  to  generate  PD  PFA  data  sets  for  veurious 
’/,  signed  to  noise  ratios.  The  noise  is  taken  to  be  zero  mean  gaussian. 

•/, 


7,  INPUTS 

'/,  SNR  (1,H)  =  set  of  signal  to  noise  ratios 

7. 


7. 


7.  OUTPUTS 

7t  PFA(400,1)=  sat  of  falsa  alema  probabilities  for  threshold  to  noise 
7i  ratios  from  minus  ten  to  plus  ten 

7  PD  (400, H)=’  set  of  detection  probabilities  for  the  same  thresholds, 

7,  with  each  column  corresponding  to  one  of  the  SNR  vedues. 

7. 

7.  [PFA,  PD]  =  glines  (SNR) 


function  [PFA, PD] =  glines (SNR) 
T^linspace(-10,10,400) ; 

PFA-0 . 5* (1-erf (T ’ /sqrt (2) ) ) ; 

PD=n; 
for  s=SHR 

PD-EPD  0.5*(l-erf((T-s)>/sqrt(2)))]; 

end 


GAUS 


1 

2 

3 

4 

5 


mxixixix/xixix/xixixixav/x/x/x/x/xayx^^^ 


7,  gaus.  Function  used  to  convert  probability  distributions  to  the 
7>  corresponding  number  of  standard  deviations  of  a  gaussian 
7,  distribution. 


7. 
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6  7.  INPUTS 

7  7,  P  (m,n)  =  matrix  of  probabilities 

8  7.  OUTPUTS 

9  7.  sds  (m,n)  =  corresponding  matrix  of  standard  deviations 

10  7. 

11  7.  sds=gaus(p) 

12  7. 

13 

14  function  sds=  gausCp) 

15  sds=sqrt(2) *erf inv(2*p-l) ; 

16  ii=f ind(sds=-inf  I  sds==inf); 

17  sd3(ii)=NaN*ones(3ize(ii) ) ; 


MAXMIN 
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7.  Function  called  maxmin  used  to  find  maximum  and  minimum  values  in 
7.  each  column  of  an  array.  The  max  and  min  values  are  explicitly  to 
7.  ignore  the  presence  ofNaN. 


7. 


7.  INPUTS 

7.  A  (M,N)  =  Array  uhose  max  values  are  to  be  found 

7. 


7.  OUTPUTS 

7.  mx  (1,N)  =  String  of  maxi  mum  values 
7.  mn  (1,N)  =  String  of  mini  mum  values 

7. 


7i  [mx,mn]=maxmin(A) ; 


function  [mx,mn]=maxmin(A) 
CM,H]=size(A)  ; 
mx=0  :  mn=0  j 
for  n=l:H 
a=A(: ,n) ; 

ii=f ind(isnan(a) ) ; 
a(ii)=zoros(3ize(ii)) ; 
b=mai(a) ; 
if  b==0 

b=miTi(a)  ; 

a(ii)=b*onas(size(ii)) ; 
b=Eiaz(a) ; 
end 

mi=0nx  b]  ; 
b=min(a) ; 
if  b==0 

b=mai(a) ; 

a(ii)=b*ones(size(ii)) ; 
b=min(a) ; 

end 

mn* Imn  b3 i 
end 


PDPFAEFF 
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5 
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11 

12 
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7.  Function  called  PDPFAeff  used  to  calculate  a  set  of  random  error 
7.  results  for  the  estimated  (PD,PFA)-pair  for  operator 
%  (random)  performance  results.  The  PD,  PFA  random  performance  results 
7,  are  dravn  from  a  set  vhose  distribution  is  governed  by  some  nominal 
7.  snr  and  the  number  of  trials.  It  is  assumed  that  half  the  trials 
7.  have  targets  and  half  do  not,  and  that  the  operator’s  effective 
7.  threshold  is  at  half  the  nominal  snr. 


7. 


7. 

7,  INPUTS 

7.  H  (1,1)  =  number  of  trials 

7,  snmomdil)  -  nominal  signal  to  noise  ratio 
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14  Vi  M  (1,1)  =  number  of  monte  carlo  simulations  to  be  run 

15  */. 

16  •/. 

17  V.  OUTPUTS 

18  ■/.  sigPDc  (1,1)  =  standard  deviation  of  random  PD  results  using 

19  y.  std(PD) . 

20  ■/.  sigPFAcd,!)  =  standard  deviation  of  random  PD  results  "  "  " 

21  '/,  PDH  (1,1)  =  Monte  Carlo  Probability  of  detection. 

22  y,  PFAM  (1,1)  =  Monte  Carlo  probability  of  false  alarm. 

23  y. 

24  y. 

25  y.  CsigPDc,sigPFAc,PDM,PFAM]=PDPFAeff(H,snmom,M) 

26 

27  function  [sigPDc,sigPFAc,PDM,PFAM]=PDPFAeff(H,snmom,M) 

28  if  'exist(’M’)!  M=le3;  end 

29  p=(l-6rf  (snmom/(2*sqrt(2))))/2: 

30  q=l-p; 

31  hN=H/2: 

32  R=rand(l,hN*M) : 

33  ii=R<q; 

34  ii=ra3hape(ii,hH,M) ; 

35  TT=sum(ii) ; 

36  ii=R<q; 

37  ii=re3hapa(ii,hN,M) ; 

38  HH=sinii(ii)  ; 

39  ii=find(TT==hNITT=0): 

40  TT(ii)  =  n; 

41  NH(il)  =  n: 

42  ii=find(NN==hNlHH=0); 

43  TT(ii)  =  a; 

44  HH(ii)  =  a: 

45  PD=TT/hK: 

46  PFA=l-NN/hH: 

47  PDM=mean(PD) ; 

48  PFAM=mean(PFA) ; 

49  sigPDc=std(PD) ; 

50  sigPFAc=std(PFA) ; 


PRBPRBER 
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y,  prbprber  Function  used  to  plot  a  pair  of  probability 
y,  distributions  against  each  other  on  a  graph  whose  scales  each 
y,  correspond  to  the  gaussian  distribution  .  This  program  displays 
y,  error  bars  on  operator  data  point.  This  program  allows  the  user 
y,  to  select  the  axis  size  of  the  graph. 

•/. 

•/. 

•/,  INPUTS 

*/.  PI  (1  or  m,n)  =  Set  of  probabilities  associated  with  horizontal 
'/.  axis  by  convention  PFA 


y.  P2  (m,n)  “  Set  of  probab 

7.  by  convention 

'/.  h  (1,1)  =  handle  for  gr 

■/.  s  (string)  =  string  indica 

7. 

7.  OUTPUTS 

7i  H  (1,1)  =  Handle  of  gra 

7. 

7. 

7. 

'/,  H=prbprber(Pl,P2,h,s) 

7. 

function  H=prbprber(Pl,P2,h,3) 
if  exist (’hO 

if  isstr(h) ;  s=h:  clear  h;  end 

end 


Set  of  probabilities  associated  with  horizontal 
axis  by  convention  PFA 

Set  of  probabilities  associated  with  vertical  axis 
by  convention  PD 

handle  for  graph  on  which  P1,P2  are  to  be  plotted 
string  indicating  how  data  is  to  be  displayed 


Handle  of  graph  on  which  PI,  P2  have  been  plotted 
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28 

format  long  E 

29 

labl  =  [’ 

:  .  ; 

9  ’ :  ’ 

’ ; ’  le-7  ’ :  ’  ’ ;  ’  le-5 

30 

3  3  . 

J 

’0.001 

’;’0.01 

;’0.1  ’;’0.2  ’;’  ’ 

31 

3  3  . 

t 

’0.5 

3  .  >  i  . 

>  ’;’0.8  ’;’0.9 

32 

’0.99  ’; 

’0.999 

’ ; ’  4-93  ’ ; 

’  5-93  ’ ;  ’  ’ ;  ’  7-9s  ’ ; 

33 

’  ’ ; ’  9-93 

’ :  ’ 

’1; 

34 

labela  =  [le-10 

le-9  le- 

8  le-7  le-6 

le-5  0.0001  0.001  0.01  0.1 

35 

0.2  0.3 

0.4 

0.5  0.6 

0.7000  0.8000  0.9000  0.9900 

36 

0.9990  l-le-4  1 

-le-5  1- 

le-6  l-le-7 

l-le-8  l-le-9  1-le-lO] ; 

37 

[j  j  ,ii]=>“nxmin(gaus(Pl)) 

:  jj^x(jj) 

;  ii=mln(ii); 

38 

ii=f ind(gau3(label3)<ii) 

;  ii=max(ii) 

;  if  ii==0:  ii=l:  end 

39 

j j=find(gau3(label3)>j j) 

:  jj=min(jj) 

:  if  jj==0:  jj=27;  end 

40  lablx=labl(ii; j j , 1:7) ;  labelsx=lab6ls(ii:  j j) ; 

41  [j  j  ,ii]=i!iaxniiii(gaus(P2))  :  jj=max(jj);  ii=miii(ii)  : 

42  ii=f ind(gaua(labels)<ii) ;  ii=max(ii) ;  if  ii==0:  ii=l;  end 

43  jj=find(gaus(labol3)>j  j)  :  jj=min(jj);  if  jj==0:  jj=27;  end 

44  lably=labl(ii:jj,l:7);  labalsy=labels(ii: j j) ; 

45  labelsx=gaus(labelsx) ; 

46  labelsy=gaus(labelay) : 

47  if  'exiatC’h’) 

48  hold  off 

49  cla  reaet,clf 

50  deleta(H) 

51  H=gca 

52  elae 

53  H=h: 

54  end 

55  aetCH, '  YLim’ ,  Cmindabelay)  max(labelay)] )  ; 

56  aetCH, .  [joiiiO-abolax)  maxClabelax)])  ; 

57  aet (H , ’ FontSize ’ , 6)  ; 

58  aetCH, ’xtick’ .labelax, ’xticklabela’ ,lablx, ’box’ , ’on’) ; 

59  aetCH, ’ytick’ .labalay,  ’ y t icklabela ’ , lably) : 

60  hold  on 

61  H=input(’How  many  triala  did  you  run  in  the  experiment?  ’) 

62  if  exiatC’a’) 

63  t23ig=erfinv(l-2*Pl) ; 

64  323ig=-erf inv(l-2*P2)+t23ig; 

65  3nmoni=a23ig*3qrt(2) ; 

66  [aigPDc  ,3igPFAc  ,PDm,PFAm3  =PDPFAef  f  (H^anmom) 

67  PFAe=CPl-3igPFAc  PI  Pl+aigPFAc] ; 

68  PDe=CP2-3igPDc  P2  P2+3igPDc] ; 

69  3dv=gaus(P2) ;3dh=gaus(Pl) : 

70  plotCadh.adv, ’♦’) 

71  3dve=gau3(PDa) :3dha=gaua(PFAe) : 

72  plot(3dha,3dv*ona3(3ize(3dha))) ; 

73  plot(adh*one3(3ize(adva)) .adve) ; 

74 

75  elae 

76  t23ig=erfinv(l-2*Pl) : 

77  323ig=-erf inv(l-2*P2)+t23ig; 

78  3nmora=a23ig*sqrt(2) ; 

79  [aigPDc ,  aigPFAc ,  PDm ,  PFAm]  =PDPFAef  f  (H ,  anmom) 

80  PFAe= CPl-aigPFAc  PI  PltsigPFAc] ; 

81  PDe“CP2-3igPDc  P2  P2+3igPDc] ; 

82  3dv=gau3(P2) :3dh=gaus(Pl) ; 

83  plot(3dh,3d7) 

84  3dve“gau3(PDa) ;3dhe=gau3(PFAe) ; 

85  plot(3dhe,3d7*one3(3ize(3dhe))) ; 

86  plot(3dh*one3(aiza(3dTe)) ,3dTe) ; 

87 

88  end 

89  xlabel(’PFA’): 

90  ylabel(’PD’); 

91  fig 

92  3ize=input(’  Do  you  want  to  3izo  the  graphic3  box  ?  y/n  ’,  ’3’); 

93  if  3ize==’y’ 

94  ax”input(’  Uhat  3ize  axia  do  you  want  le-l-lo-10’) ; 

95  prbprbCCax  (l-ax)3 , C(l“ax)  ax],H,’-’) 
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96  else 

97  end 


PRPRLAER 

2  V,  prprlaer  Function  used  to  plot  a  pair  of  probability 

3  y.  distributions  against  each  other  on  a  graph  whose  scales  each 

4  ■/.  correspond  to  the  gaussian  distribution  and  have  gaussline  labels 

5  '/,  and  error  bars  on  data. 

6  •/. 


7 

•/.  IKPUTS 

8 

y,  PI  (1  or  m,n) 

=  Set  of  probabilities  associated 

with  horizontal  axis 

9 

•/. 

by  convention  PFA 

10 

y,  P2  (m,n) 

=  Sat  of  probabilities  associated 

with' vertical  axis 

11 

y. 

by  convention  PD 

12 

y.  h  (1,1) 

=  handle  for  graph  on  which  P1,P2 

are  to  be  plotted 

13 

y.  s  (string) 

-  String  indicating  how  data  is  to  be  displayed 

14 

y. 

15 

y.  OUTPUTS 

16 

y.  H  (1,1) 

=  Handle  of  graph  on  which  PI ,  P2 

have  been  plotted 

17 

y. 

18 

y. 

19 

y. 

20 

y,  H=prprlaer(Pl,P2,h,s) 

21 

y. 

22 

function  H=prprlaer(Pl,P2,h,s) 

23 

if  exist (’h’) 

24 

if  isstr(h) ; 

s=h:  clear  h;  end 

25 

end 

26 

format  long  E 

27 

snrlabh=le-9j 

28 

snrlabv=[le-6  0. 

00007  0.005  0.05  0.3  0.6  0.9  0.99 

0.9995  l-le-5]  ; 

29 

labl  =  [’ 

’:’  le-9  ’:’  ’;’  le-7  ’;’ 

) , 

30 

’  la-5  ’:’ 

’!  ’0.001  ’;’0.01  ’:’0.1 

’ ;  ... 

31 

’0.2 

’ : ’  ’ ; ’0.5  ’ ;  ’  ’ ; 

;  ... 

32 

’  ’;’0.8 

’;’0.9  ’:’0.99  ’:’0.999  ’; 

;’  4-9s  ’;  ... 

33 

’  5-9s  ’ :  ’ 

’:’  7-9s  ’;’  ’;’  9-9s  ’; 

’]; 

34 

labels  =  [le-10 

le-9  le-8  le-7  la-6  le-5  0.0001  0, 

.001  0.01  0.1  ... 

35 

0.2  0.3 

0.4  0.5  0.6  0.7000  0, 

.8000  0.9000  0.9900  . 

36 

0.9990  l-le-4  1 

.-le-6  l-le-6  l-le-7  l-le-8  l-le-9 

1-le-lO] : 

37 

[j  j  ,ii]=maxmin(gau3(Pl))  ;  jj=max(jj);  ii=iain(ii); 

ii=find(gau3(labels)<ii)  :  ii=inai(ix) ;  if  ii~D;  ii=l:  end 
j j=f ind(gau3(label3)>j j)  ;  jj=min(jj);  if  jj==n;  jj=27;  end 
labli=labl(ii: j j , 1:7) ;  labelsi=labels(ii: j j) ; 

[j  j  ,ii]=inaimin(gaus(P2))  ;  j  j=iiiax(j  j)  ;  ii=]iiin(ii)  ; 
ii=find(gaus(labols)<ii) :  ii=inax(ii) ;  if  ii^Q;  ii=l:  end 
jj=find(gaua(labels)>jj) :  jj=min(jj);  if  jj==0;  jj=27:  end 
lably=labl(ii: j j , 1:7) ;  labelsy=labels(ii: j j) ; 
labelsi=gau3(labelsx) ; 
labelsy=ga\ia(label3y) ; 
snrlabh=gaus(snrlabh) ; 
snrlabv=gaus(snrlabv) ; 
if  'eiiat(’h’) 
hold  off 
cla  reset, clf 
delete(H) 

H=gca 

else 

H=h: 

end 

set(H, ’YLim’ ,  DninClabelsy)  mar(labelsy)]) ; 
set(H, ’XLiffl’ , Cmin(labelsx)  max(labelsx)]) ; 
setCH, ’FontSize’ ,6) ; 

setCH, ’xtick’ .labelsx, ’xticklabels’ ,lablx, ’box’ , ’on’) ; 
set(H, ’ytick’ .labelsy, ’yticklabela’ ,lably) ; 
for  T=l:10 
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63  if  T==l 

64  Glab=spriiitf  (’snr=  V.l.Of’.T); 

65  text(snrlabh,siirlabv(T)  ,Glab) ; 

66  else 

67  Glab=spr  intf  (’•/.!.  Of ’.T); 

68  tert(snrlabh,snrlabv(T) ,Glab) ; 

69  end 

70  end 

71 

72  hold  on 

73  N=input(’Ho«  many  trials  did  you  run  in  the  experiment? 

74  if  exist(’s’) 

75  t2sig=erf inv(l-2*Pl) ; 

76  s2sig=-erf inv(l-2*P2)+t23ig; 

77  snmonF=a2aig*sqrt(2) ; 

78  [a  igPDc ,  sigPFAc ,  PDm ,  PFAm]  =PDPFAef  f  (U ,  snmom) 

79  PFAe=CPl-3igPFAc  PI  Pl+aigPFAc] ; 

80  PDa=[P2-sigPDc  P2  P2+3igPDc] ; 

81  adv=gaua(P2) ;sdh=gau3(Pl) ; 

82  plot(sdh,sdv, ’»’) 

83  sdve=gaua(PD6) ;sdhe=gau3(PFAe) ; 

84  plot(sdhe,sdv*onea(3iza(sdhe))) ; 

85  plot(sdh*one3(size(sdve)) .adve) ; 

86  else 

87  t2sig=erf inT(l-2*Pl) : 

88  32sig=-erf inv(l-2*P2)+t23ig; 

89  3nmom=a23ig*3qrt(2) ; 

90  [aigPDc ,  aigPFAc ,  PDm, PFAm]  =PDPFAef  f  (H , snmom) 

91  PFAe=[Pl-3igPFAc  PI  Pl+aigPFAc]  ; 

92  P0a=CP2-aigPDc  P2  P2+aigPDc] ; 

93  sdT=gau3(P2) ;adh=gau3(Pl) j 

94  plot(adh,adv) 

95  3dvo=gau3(PDe) isdhe=gau3(PFAe) ! 

96  plotCsdhe.sdv+oneaCaizeCsdhe))) ; 

97  plot(sdh*ones(3iZ8(sdva) ) ,sdve) ; 

98  end 

99  xlabel(’PFA’) i 

100  ylabel('PD’): 

101  prbprbCC. 0000000001  . 9999999999] ,[. 9999999999  .0000000001] ,H, ’.’) ; 

102  hh=H 

103  load  start 

104  prbprb (PFA , PD , hh) 

105  fig 


SNRCALC 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 


'/,  Function  called  snrcalc  designed  to  calculate  the  signal  to  noise 
y,  voltage  ratio  of  a  target  in  random  white  Gaussian  noise. 

•/. 


•/. 

y.  INPUTS 

y,  sig  (1,1)  = 

y,  noise  (1,1)  = 

y.  D  (1,1) 

y. 

y.  G  (256,256)  = 

y.  Hsub  (1,N) 
y.  filt  (Nsub,Nsub)= 

y. 

y.  OUTPUTS 
y,  sigma  (1,1) 

y. 

y.  signal  (1,1)  = 

y. 

y. 

y,  snr  (1,1) 


Input  pixel  value  of  taurget 

Iz^ut  pixel  value  of  noise 

Diameter  of  circular  disc  to  be  used  in 

defining  the  filter;  D  must  be  odd. 

Background  scene  (RWG) 

Size  of  background  scene  to  display 
unit  pillbox  filter 


standard  deviation  of  the  of  the  pixel  values 
when  no  target  was  present.  The  noise, 
mean  value  of  the  pixels  when  the  target  was 
present  minus  the  mean  value  of  the  pixels 
when  no  target  was  present 
Signal  to  noise  ratio 
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22  7,  snmom  (l.l)  =  nominal  signal  to  noise  ratio 

23  7. 

24  7. 

25  7,  [sigma, signal, snr,snmom]=snrcalc(sig, noise, D, G,  ,Hsub,filt) ; 

26 

27  function  [sigma, signal , snr , snmom]=snrcalc(sig,noise ,D , G,Nsub,filt) ; 

28  R=(D-l)/2; 

29  RH=(Hsub-l)/2; 

30  x=(-RN:RN) . ‘2; 

31  x=ones(size(x’))*x; 

32  R2=x+x'; 

33  ii=find(R2<=R‘2) ; 

34  L=length(ii) ; 

35  pd=256-Hsub ; 

36  qd=256-Nsub ; 

37  Suml=  □  : 

38  N=1000; 

39  for  b=l:M 

40  (RN+l)+pd*rand(l,l) ; 

41  y=  (RN+l)-t-qd*rand(l ,  1)  ; 

42  Z=  G(x-RN:x+RH,y-RH:y+RH) : 

43  Suml=[Suml;  sum(sum(Z .  *f  ilt)  )]  ; 

44  end 

45  Sums= [Suml ♦noise  Suml^noise+sig^L]  ; 

46  3igma=3td(Siims(:  ,  1) ) ; 

47  bac!c=maan(Sum3(:  ,1)) : 

48  taTg=maan(Sui[i3(:  ,2)) ; 

49  3ignal=targ-back; 

50  3nr= (signal)/ 3 igma; 

51  sinoiii=L^aigj 

52  nonom  =  sqrt(L*(noise' 2)) ; 

53  anrnom=slnoBi/nonomj 


SNRESTER 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 


%  Function  called  snrester  used  to  calculate  a  set  of  random  error 
7>  results  for  the  estimated  signal  to  noise  ratio  for  PD,  PFA 
7,  operator  (random)  performance  results.  The  PD,  PFA  random 
7,  performance  resultsare  draun  from  a  set  vhose  distribution  is 
7,  governed  by  some  nominal  snr  and  the  number  of  trials.  It  is 
7,  assumed  that  half  the  trials  havetargets  and  h2df  do  not ,  and  that 
7.  the  operator's  effective  threshold  is  at  half  the  nominal  snr. 

7. 

7. 

7.  INPUTS 
7.  H  (1,1) 

7,  snmomd,!) 

7.  M  (1,1) 

7. 

7. 

7.  OUTPUTS 

sigsnr  (1,1)=  standard  deviation  of  random  snr  results 
7,  snrbar  (1,1)=  mean  value  of  random  snr  results. 

7.  ransnr  (1,M)=  set  of  random  snr  results. 

7.  PDM  (1,1)=  Monte  Carlo  Probability  of  detection. 

7,  PFAM  (1,1)=  Monte  Carlo  probability  of  false  alarm. 

7. 

7. 

7,  [sigsnr , snrbar , PD , PFA, ransnr]  =snre3ter(H , snmom, M) 


number  of  trials 

nominal  signal  to  noise  ratio 

number  of  monte  carlo  simulations  to  be  run 


f unct  ion  [s igsnr ,  snrbar ,  PDM ,  PFAM ,  ransnr] =siir est er ( H ,  snmom ,  M) 

if  "existCM’);  M=le3;  end 

p=  ( 1-erf  (snmom/  (  2^3qrt  (2))))/2; 

q=l-p; 

hN=H/2: 

R=rand(l,hH%M) ; 
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33  ii=R<q; 

34  ii=reshape(ii ,hN ,M) ; 

35  TT=suin(ii)  ; 

36  ii=R<q; 

37  ii=resliape(ii,hH,H) ; 

38  NH=suin(ii)  ; 

39  ii=find(TT==hNlTT==0) ; 

40  TT(ii)  =  []: 

41  NN(ii)  =  n; 

42  ii=f  iiid(NN==hN  I  HH=0) ; 

43  ■rr(ii)  =  n; 

44  NN(ii)  =  n: 

45  PD=TT/hH ; 

46  PFA=l-NH/hH; 

47  t2sig=6rf  iiiv(l-2*PFA) ; 

48  s23ig=-erf  iiiv(l-2*PD)+t23ig: 

49  raii3nr=s23ig*aqrt(2)  ; 

50  3iirbar=mBan(raiisnr)  ; 

51  sig3iir=std(ransiir) ; 

52  PDM=iiiean(PD) ; 

53  PFAM=1-PDM: 


MAKEPILL 
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*/,  Function  called  makeplll  used  to  generate  a  unit  pillbox  of 
*/,  target  3ize. 

y. 

% 


•/.  INPUTS 

y,  Nsub  (1,1)  =  Size  of  the  portion  returned  of  whitened  signal 

•/,  disc  (an  odd  nuabor) 

y.  D  (1,1)  =  Circle  diameter  (an  odd  number) 

y. 

y.  OUTPUTS 

y. 

y,  pill  (H3ub,Nsub)=  Box  containing  signal  disc  at  center 

y. 

y,  pill=makepill(Nsub,D) 


function  pill=makapill(Naub,D) ; 

R=(D-l)/2; 

if  rem(Hsub,2)=l 

x='((-(Nsub-l)/2:  (Naub-l)/2)) .  '2; 
x=«onos(size(x  ’ ) )  *r ; 

R2=x-t-x’ ; 

ii=*find(R2<=R‘2)  ; 
pill=zero3 (Nsub, Nsub) ; 
pill(ii)=ones(size(ii)) ; 
else  rem(N3ub,2)==0; 

x“(-Nsub/2: (Naub/2-1) ) . " 2; 
x~ones (sizo(i’))*r: 

R2»rtx' ; 

ii=f  inid(R2<=R“  2)  ; 
pill=zeros(Nsub,Nsub) ; 
pill(ii)=ones(size(ii)) ; 
end 


SCALINGl 


1 

2 

3 

4 

5 

6 
7 


y.  Function  called  sccilingl  used  to  scale  the  display  to  show  pixels 
y.  having  a  value  some  specified  number  of  standard  deviations 
y,  about  the  mean. 

y. 

y. 

y.  INPUTS 
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8 

y,  zsi 

(51.51) 

=  image  with  target 

9 

A  Tnm 

(1.1) 

=  mean  value  of  the  target  region 

10 

y.  SD 

(1,1) 

=  pixel  standard  deviation  in  sub  without 

target 

11 

y.  scale 

(1,1) 

=  half  the  number  of  standard  deviations 

in  full 

12 

y. 

display  dynamic  range 

13 

y.  R 

(1.1) 

=  Target  circle  radius 

14 

y. 

15 

y. 

OUTPUTS 

16 

y,  zsii 

(51,51) 

=  scaled  and  limitted  version  of  sub 

17  •/. 

18  y.  Z3ll=scalingl(sub, mm, SD, scale, R) 

19 

20  function  zsll=scalingl(z3l , mm, SD , scale ,R) ; 

21  b=l/(2*3cale*SD) ; 

22  a=-b*(iiin-scale*SD) ; 

23  zsll=a+b*z3l ; 

24  j jl=f  indCzslKO)  ;zall(jjl)=zero3(size(j  jl))  ; 

25  j ju=f ind(zsll>l) ;z3ll(j ju)=onea(size(j ju)) ; 


SCALING2 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 


t 

•/. 

•/. 

•/. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 


Function  called  scaling2  used  to  scale  the  display  to  show  pixels 
having  a  value  between  the  minimum  value  of  background  scene  pixels 
and  a  value  near  the  mean  value  of  the  background  scene  pixels. 


IHPUTS 

Z32  (51,51) 

mm  (1,1) 

SD  (1,1) 

scale  (1,1) 

R  (1.1) 


image  with  target 

mean  value  of  the  target  region 

pixel  standard  deviation  in  sub  without  target 

the  number  of  standard  deviations  in  full  display 

dynamic  range 

Target  circle  radius 


OUTPUTS 
Z321  (51,51) 

scale  (1,1) 
[zs21,  scale] 


scaled  and  limitted  version  of  zs2 

the  number  of  standard  deviations  in  full  display 

seal  ing2(sub  ,inii,SD  .scale  ,R) 


function  Czs21,scale]=scaling2(zs2, mm, SD, scale, R) ; 
F=l; 

while  F==l; 

x=(-R:(R-l))."2; 
x=ones ( s ize (x ’ ) ) *x : 

R2=x+x' ; 

ii=*flnd(R2<=R‘ 2)  ; 
msub=zs2 ; 

msub(ii)=onea(3ize(msub(ii)))*min(msub(ii(:))) ; 
HH’nnin(msub( ;  )  )  ; 

MEAH=mean(msub ( : ) ) ; 
scale 1= ( (KEAN) -MN) /6 ; 

MH2=HH+(scale+l) *scalel ; 
zs21=zs2 ; 

uu“find(zs2>=MN2) ; 

zs21(uu) =ones (size (zs21 (uu) ) ) *HH2 ; 

if  min(min(zs21) ) '=max(inax(zs21))  ; 

F=0; 


else  scale==scale*1.5; 
end 


end 


SCALINGS 


1 

2 


y.  Function  called  scaling3  used  to  scale  the  display  to  show  pixels 


136 


3  "/,  having  a  value  between  the  maximum  value  of  background  scene  pixels 

4  */,  and  the  meeui  value  of  the  background  scene  pixels. 

5  7. 

6  7. 

7  7.  INPUTS 


8 

7.  zs3 

(51,51)  =  image  with  target 

9 

7,  mm 

(1,1)  =  mean  value  of  the  target  region 

10 

7.  SD 

(1,1)  =  pixel  standard  deviation  in 

sub  without  target 

11 

7,  scale 

(1,1)  =  half  the  number  of  standard 

deviations  in  full 

12 

7. 

display  dynamic  range 

13 

7.  R 

(1,1)  =  Target  circle  radius 

14 

7. 

15 

7. 

OUTPUTS 

16 

7.  zs31 

(51,51)  =  scaled  and  limitted  version 

of  sub 

17 

7. 

18 

y,  Czs31 , scale]  =acaliiig3 (sub, mm, SD  .scale, R) 

19 

20 

21  function  [xsSl, 3cala]=3caling3(zs3, mm, SD, scale, R) ; 

22  F=l: 

23  while  F==l ; 

24  x=(-R:(R-l)). '2; 

25  x=onea(3ize(x’))*x; 

26  R2=i+x' : 

27  ii=find(R2<=R“2) : 

28  msub=z33 ; 

29  m3ub(ii)=zeros(slze(iii3ub(ii))) ; 

30  MX=max(m3ub(:)) ; 

31  HEAN=mean(m3ub(:)) ; 

32  scale 1= (MX- (MEAN) )/6: 

33  MX2=MX-((8cale)*3calel) ! 

34  zs31>zs3 ; 

35  ll=f ind(zs3<=MEAK) ; 

36  zs31(ll) =ones (size<zs31(ll) ) )*MEAN ; 

37  uu“f ind(zs3>=KX2) ; 

38  zs31 (uu) =ones (sizeCzsSlCuu) ) ) *MX2 ; 

39  if  min(min(zs31) ) ~°max(maz(zs31)) ; 

40  F=0: 

41  else  scale=(scale-.5) ; 

42  end 

43 

44  end 


SHOWR 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 


7.7.7.7.7.7.7.7.7.7.7.7.7X/.7.7.7.7.7.7.7.7.7X/.7.7.7.7.7.7.7.7X/.7.y.7.7.7.7,7,7.7X 


7,  Function  called  shovr  used  to  display  in  grayscale  format 
%  a  data  array,  with  a  specified  position  and  size,  used  with  real 
7.  background  noise.  The  program  highlights  the  target  area  with  a  ring 
7,  of  target  circumference. 


7. 

7. 

%  subl 
7.  a 
7.  b 
7.  c 
7.  d 
7.  R 


INPUTS 

(H,H)  =  data  array  for  display 

(1,1)  =  x-azis  position  LL  comer 

(1,1)  =  y-axis  position  LL  comer 

(1,1)  ”  x-axis  image  size 

(1,1)  =  y-axis  image  size 

(1,1)  =  circle  radius 


7. 

7.  showr(subl,a,b,c,d,R) 


function  showr(subl,a,b,c,d,R) 

x=(-R:(R-l)).‘2; 

x=ones(size(x’))*x; 
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23  R2=x+x ’ ; 

24  ii=find(R2<=R'2) ; 

25  AX  =  axesC ’position' ,  [a  bed]); 

26  axesCAX) ; 

27  axis  off ; 

28  coiormapCbone) ; 

29  caxis(’auto’) ; 

30  pcolor(subl) : 

31  shading  flat 

32  hold  on; 

33  [M,tO-size(subl)  ; 

34  t=linspace(0,2*pi,100) ;cy=(R+l)»sin(t) ;cx=(R+l)*cos(t) ; 

35  plot(cx+(M/2+l) ,cy+(M/2+l) , ’y; ’) ; 

36  cx=ones<l,100) ;  cy=linspac6(l,N,100) ; 

37  plot(cx,cy, ’y’) ; 

38  cx=N+onea(l ,100) ;  cy=llnspace(l ,N, 100) ; 

39  plot(cx,cy, ’y’) ; 

40  cy=onos(l, 100) ;  cx=linspace(l,N,100) ; 

41  plotCcx.cy, ’y’) ; 

42  cy=H+one3(l , 100) ;  cx=linspace(l,H,100) ; 

43  plot(cx,cy, ’y’) ; 

44  hold  off ; 

45  axis  off ; 

46 


WRITEFIL 


1 

2 

3 

4 

5 

6 


y.yxmy.y.y.7.y.y.y.y.v.y.mr/.y.r/.r/.my.mr/.yx/.7x 

y,  function  called  writefila  designed  to  write  experimenteil  data 
y,  to  a  .mat  file  and  a  .txt  file  for  future  use.  The  .mat  files  axe 
y,  called  opudata-.mat  and  the  text  files  are  called  dataopw.. 

y. 

y. 


7 

y.  INPUTS 

8 

y.  n 

(1.1) 

=  number  of  displays 

9 

y,  Hsiib 

(1,1) 

=  size  of  the  background  scene  for  display. 

10 

y.  D 

(1.1) 

=  circle  Diameter 

11 

*/•  sig 

(1,1) 

=  Target  signal 

12 

y,  noise 

(1.1) 

=  Target  noise 

13 

y,  snmom 

(1.1) 

==  nominal  signal  to  noise  voltage  ratio 

14 

y,  sigsnr 

(1,1) 

=  standard  deviation  of  the  signal  to  noise 

15 

y. 

ratio 

16 

y.  cl 

(2,1) 

-  number  of  times  target  was  present  and 

17 

7. 

detected 

18 

y,  c2 

(2.1) 

=  number  of  times  teirget  was  present  emd  not 

19 

7. 

detected 

20 

7.  c3 

(2.1) 

=  number  of  times  no  target  and  no  detection 

21 

y.  c4 

(2,1) 

=  number  of  times  no  teirget  and  false  detection 

22 

y,  PDo 

(1,1) 

=  Probability  the  target  was  present  and  the 

23 

7. 

operator  identified  it 

24 

7.  PFAO 

(1,1) 

=  Probability  the  target  was  not  present  but 

25 

y. 

the  operator  thought  it  was  present 

26 

y.  snrexp 

(1,1) 

=  Signal  to  noise  voltage  ratio  of  the  operator 

27 

7. 

during  the  experiment 

28 

y. 

29 

7. 

30 

y,  OUTPUTS 

31 

y,  none 

32 

7. 

33 

y.  writefil(n,cl,c2,c3, 

c4 ,  snrexp ,  PDO ,  PFAO  .sigsnr ,  sig ,  snmom ,  D ,  Nsub) 

34 

35 

function  writefiKn.cl 

,  c  2 ,  c3 ,  c4 ,  snrexp ,  PDO ,  PFAO ,  s  igsnr ,  s  ig ,  snmom ,  D ,  Hsub  ) 

36 

write-inputC 

Is  this  a 

new  file?  Cy  if  a  new ;  any  key  if  not  ]  » ’ , ’ s ’ ) ; 

37 

if  writo=”’y’ 

t 

38 

load  fnum; 

39 

fnui^fnuaH-1 ; 

40 

save  fnum  fnum; 
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41  f  id=f  openCsprintf  ( ^dataopw#'/,! .  Of  *  ,’w*) ; 

42  operator=input(’ please  enter  your  first  and  last  name  >>’,’s’); 

43  fprintf (fid, operator) : 

44  fprintf  (sprint f(  ’  dataopw#'/,! .  Of  ’  ,fnum)  ,  ’\nn=*/(l  .Of  \ncl=*/.l .  Of  .  .  . 

45  \nc2=‘/.1.0f\nc3=y,1.0f\nc4='/.1.0f\nsnrexp=y.7.6f\nPD0=‘/.7.6f  . .  . 

46  \nPFAQ=y.7.6f\nsigsnry.7.6f\nsig=y.4.3f\nsnmom=y.5.4f\nD=y.l.0f  .  .  . 

47  \nNsub=y.l.0f\n\n'  ,n,cl  ,c2,c3,c4,snrexp,PD0.PFA0,sigsnr,sig,  .  .  . 

48  snmom,D ,Nsub)  : 

49  else 

50  load  fnum 

51  fprintf  (sprintfC dataopw#*/,!. Of  ’  ,fnum) ,  ’\nn=‘/.1.0f\ncl='/.1.0f  .  .  . 

52  \nc2=*/,1.0f\nc3=’/.1.0f\nc4=‘/.1.0f\n3nrexp=*/.7.6f\nPDQ=‘/,7 .6f  ... 

53  \nPFA0=‘/.7.6f\nsigsnr'/.5.6f\nsig=‘/.1.0f\n3nmom=*/.5.4f  ... 

54  \nD=‘/.1.0f\nNsub=‘/.1.0f  \n\n’ ,n,cl,c2,c3,c4,snrexp,PD0,  ... 

55  PFAQ.sigsnr  .aig.snmom.D.Hsub)  : 

56  end 

57 

58 

59 


CHECK 
1 
2 

3 

4 


24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 


function  called  check  used  to  enstire  that  in  an  experiment  an 
operator  performs  within  an  acceptable  limit  (two  standard 
deviations)  of  the  nominal  signal  to  noise  voltage  ratio. 


=  nominal  signal  to  noise  voltage  ratio 
=  number  of  times  target  was  present  and 
detected 

=  number  of  times  target  was  present  and  not 
detected 

=  number  of  times  no  target  and  no  detection 

-  number  of  times  no  target  and  false  detection 

-  standard  deviation  of  the  signal  to  noise  ratio 


=  Probability  the  target  was  present  and  the 
operator  identified  it 

=  Probability  the  target  was  not  present  but 
the  operator  thought  it  was  present 

=  Signal  to  noise  voltage  ratio  of  the  operator  during 
the  experiment 

=  experimental  exit  flag,  flag  =1  stops  experiment 


[PDO ,  PFAO ,  snrexp ,  f  lag]  =check(cl ,  c2 ,  c3 ,  c4 ,  snmom,  sigsnr ) 


5 

•/. 

INPUTS 

6 

y,  snmom 

(1,1) 

7 

y.  cl 

(2,1) 

8 

y. 

9 

•/.  C2 

(2,1) 

10 

•/. 

11 

'/.  c3 

(2,1) 

12 

'/.  c4 

(2,1) 

13 

*/,  sigsnr 

(1,1) 

14 

•/. 

15 

y. 

16 

•/.  OUTPUTS 

17 

y.  PDO 

(1,1) 

18 

•/. 

19 

•/.  PFAO 

(1,1) 

20 

y. 

21 

'/,  snrexp 

(1,1) 

22 

•/. 

23 

y.  flag 

(1,1) 

function  [PDO, PFAQ, snrexp, flag]=chack<cl,c2,c3,c4, snmom, sigsnr)  ; 
PD0-cl/<cl+c2) : 

PFA0=c4/(c3+c4) ; 
t2sig=erfinv(l-2+PFA0) ; 
snroip=sqrt(2)*(t2sig-erf  lnv(l-2*PD0)) ; 
lower=snmom-l .  96*sigsnr ; 
iq>per”snmoiiH-l .  96*sigsnr ; 

if  snrexpc  lower  I  snrexp  >  vq>per; 
dispC’you  are  out  of  tolerance’); 
sprintf  ( ’your  snrexp  is  :  '/.5 . 4f ’, snrexp) 

sprintfC’the  acceptable  tolerance  is  :  ■/3.4f  to  '/,5 . 4f ’, lower , 
upper) 

cont=input C ’ do  you  want  to  8top?[y  stops  the  test,  any  key  to 
continue  ]  »’,  ’s’); 
if  (cont“=’y’) ; 

flag=l; 

else 

flag=0; 

end 
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46  else  sprintf  ( ’GOOD  JOB!  your  snrexp  is  :  ’/,5.4f  ’  .snrexp) 

47  fl2ig=0; 

48  end 

49 
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APPENDIX  D.  MONITOR  DISPLAY 


This  appendix  contains  greyscale  representations  of  the  monitor  display  shown  to  the  operator  for 
each  of  the  experiments  In  each  display  there  is  a  target  present  however  the  reader  may  not  percieve 
the  target  in  every  display.  In  the  experiments  the  operator  only  had  to  identify  a  target  in  a  single 
display.  If  he  could  see  the  target  in  any  of  the  eighteen  greyscale  representationsthen  he  made  the 
decision  that  the  target  was  present. 
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EXPERIMENT  1  MONITOR  DISPLAY 
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EXPERIMENT  2 


DISPLAY 
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EXPERIMENT  3 


DISPLAY 


144 


INITIAL  DISTRIBUTION  LIST 


l-Dcfcnsc  Technical  Information  Center 
Cameron  Station,  Bldng  5 
Alexandria,  Virginia  22304-6145 


2. Library,  Code  52 . 

Naval  Postgraduate  School, 
Monterey,  California  93943-5101 


3. Prof  Fried  D.  L . 

Dept.  Physics,  Code  PH/Fd 
Naval  Postgraduate  School, 
Monterey,  California  93943-5002 


4. Prof  Davis  D.  S . 

Dept.  Physics,  Code  PH/Dv 
Naval  Postgraduate  School, 
Monterey,  California  93943-5002 


5. Prof  Colson  W.  B . . 

Chairman  Dept.  Physics,  Code  PH/Cw 
Naval  Postgraduate  School, 

Monterey,  California  93943-5002 


